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iTttSTBlCT . ■r ' 

This evaluation report is presented at the exclusion 
C9f the -third year of Project issist, a^progras funded under the 
l^ergeaqr School assistant Act (ESiA) . The sain focus of the- pro^ct 
ij:*as on iiprcving student reading and aatheaatics skills priMrily 
%hr^gh contact »ith instructional teacher aides and special\ a 
jsitpplesenUry instrucUonal aaterials. Included rithin the third^ear 
t^'of the pr^grai vere t*o additional coaponents: Project Outreach, 

v^lch called for graduate social vork interns to work with children 
" referred/because of behavioral or attitudinal probleas; and Trilogy, 
vlilch eaployed a triethnic school-coaaunity theatrical troup4 to 
portray student-teacher situations in a satirical fashion. In 'this 
report each prograa is described in detail and its'^utcoae evaluated. 
Included in the docnaent are the- reports of three outside 
consult ant8« (JD| 
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ABSTRACT 



'evaluation of ESAA III PILOT PROJECT ASSIST. 1^75-76 : . ' , 

pMcriP'tion of Program 

Thie yMT HMi^roJect 'Assist 'b third year of funding as an ESAA Pilot 
ProJttet« As in years past, the isain focus of the project was 09 ii^roving 
st«4ent read^ skills, primarily through contact «7ith instructional^ teabher 
aides Md special suppleoumtary instructional materials^ The project. also „ 
centimed to be directed toward s^tudents at both elemwtary and junior 
hifjti *school/levels. ' * * 

Hoire^er, several changes were isade in this yearns program, Nev coappnents 
vere added. Project Matti, a -program parallel to t;^e alrei^y existing Project 
KMdt vas to be iiis tailed in pne of , the project junior hi^ schools. ' fhere 
vas alsa a component called Project Outreach which call jd icnif gimiv^^e social work 
interns from die Iftitversity of Texas to work with, childrrai referred because 
of bdMvioral or attitudinal probJ^ems*. ' Trilogy was another* new component 
which e^ployed a tri-athnic school^commtinity the^tricaj^ troupe to portray . 
student-' teacher situations in a* satirical fashion. / ^ 

The elementary schools served by the project werexhai^t^^ and' one junior 
high school received /ext^ed services. This year's Project Asiiist schools 
were: Kosewoodi Oak springs, *and Sins elsmentary schools and MartiA atsd Allim 
junior high schools. « 

Funding for this year's project, not including iiM>ney for evaluation, cme to 
$325,143. Staff were, to include a Coordinator and a Staff Development 
Speci^^ist, aa well as 32 instructional aides and 2 secretaries. , 

Evaluation Purposes 

Becatise of a shortage in fun^s awarded fbr evaluation (see belowJ this year's 
^flustion of Broject Assist had modest goals. The AISfi'Offiqe of Research 
(^ad Eva|.uatlon collected information only on the attainment of « a few outcome 
objectives. An atteBq>t was also made to pro^riSe some minimal information on 
progrsm iaploientation and management by contfact!ing with outside consultants 
to collect and report such information based on mid-year and year-*end program 
audits. The program evaJLua tor combined information from both of the above 
sources to provide relevant data for a sm^ll number of decision questions* 

Evlluation Activities * - . 

» 

This ytar, only $10,056 was provided for evaluation of l^roject Assist. Of 
this amount, $3,500 was allotted to pay outside consaltants to perform ' 
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It and process audits* "An additional $5»000 was allocated tdl pay 
tlie ealibry of a half -time intern te collect v analyze » and report outcome 
inforsation^'as well as to liire'end co-ordinate the %fork pf the outside 
consttltantp* - . ' /"^ . • 

Outaaae Ohjectives ; The outcome objectives^ were designed to measure ' 
^jpossible changes inc^he achievement^ attitudes, and behavior of flrtudenta 
,and in the attitudes of faculty » m a result of >^tact nith the various 
Project Assist' co^^onents. For Project Read and Project Math». there was 
an analysis of achievs^ient aata» using tde Reading and Math, iubtesti of the 
Calil^omia Achifvemott Test as the critericm measures. Data were also col- 
lectn^ron attitiMe .chAnges for the Hath coiqpofisnt» using i^e Math Attitude 
teat. 'Teacher ratings of. success of the Outreach coaqponent were^reeor^^ 
on d questidnnairi^ constructed by* the Evaluat6r. AMther ffuiteticmnaire * 
recorded audience comprehension of Triloj^ gdals and tatii^ of the troMpi&^s 
• success in' meetii^ ^ose goals. The evaluation, design Also eallad' f or in^ 
formation to be gathered on changes in ethnif attitudes for Froject Assist 
students participating in Trilogy. However » this aspect of * the TMlogy com- 
ponent was not in^lijpented^ so this information was no^ collected* 

Evaluation Findings 

Th^ following information r^pr^senta a. summary of this yearns findi'nga* Both 
outcome data collected by the Evaltiat or. employ^ b^ the, Off ice of Research end 
Evaluation m^d proems and management data collectid by the •cbtside oonmltants 
were obnsidered in compiling this sjummary. Itost of ^the Inf^rmatiotft given below 
was pr€p«nted in the report section containiM decision quesl^icmst althc^gb « 
some additional information was pulled from /report actions degling'with the 
progrM context* and j5iterrelationshi|>s b^^eot-program i^»lep«»itation And 
outcomes. - / 

Program ImplemeAtation and Achievement 0f Objectives : Froject Reed and Project 
M»th were implemented to some degree: /materials were orders^^ And aides nwre^^ ^ 
in claasrooms. However » the proposed/curriculum was largely tttt|mf(lsmeiited« ' \ 
Very, lit tie training wa^ prov^ed for addes» none fbr teacihers.^. Readily and ^ 
math outcome achievement goals were not met » nor were ^mattaf goals f or i^>rpved 
math attitudes met. ^ ^ . 

It wfs suggested in the Interrelatiodships section of the report that lArfc 
of sufficient aide and teacher training may have be^ a (Bignificant factor 
in the fallur/e of the cooqponents tcf* achieve their outcome objectives. Evi* 
^dence from the previous year's evaljiAtion Vas given to supp^art this view^ 

Trilogy did not^ incorporate Project , Assist students this xear'nnd did not 
provide' the nuoiber t)f performances proposed for Project Assist ^^chools. By 
the close of the yedr^ a start had been made at developing a teacher training 
model and at collecting information to help esqpand Trilogy to ^he elementary * 
level* Trilogy had met two of the outcome objectives set for it» ^ich 
speciCi^ that audiences wou^d perceive Trilogy goals an(| sef troupej membedi 
aa pursuing those goals effectively. Because of lack of implementation of 
this component^ no information was gathered on* change in interethnicf Attitudes 
fisof^ Froject Assist Trilogy members. \ 

Pyp'ffCJt Outreach was implemented essentially as proposed. Its outcome 
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c^|Mtivr» t^oneerning teacher ratings of improvement in referred -students* 



Cost of froi^m Components; iJLt was tiot^ in the body ot the repwt that, of 
the $335,199 granted to Project Assist this year, $293,400 (almost 90Z of the 
fvmds) mxm allot t#d to Project tead^ and Project Math, t^^logy. was to re- 
ceive $1750 and*ProJ[ect Outreach^vas to receive $1426. Awiniatratlve am 
clerical support service? were fudled at $28,567 and^ as i^orted above; 
Zvaluation was funded at $10*056. 



^ Proiect Context ; Sote of the. events stkrrounding the project Which were not ^ 
vithin t& control of^ project panageiient were disdussed^ These factors 
included the. late release of federal funds and the resignation of %he previous 
Project Coordinator; with the ensuring vacancy, in^ the Staff Oe^alc^aent 
Spacialist position. (Both, release of funds and the Ooordinatbr*a resigns- 
^ tioti' occurred in early September 1975,) i^ther cote«t^ial faetoaf hljodioring , 
progT^m isiplnentatxon was the failure (o resolve^discrej^mcies heMiNm <^ U 
iprbposed^ program activiti^'aifd actual school eqplo^MSst oi ^tc^ram resbtf:(^es/ 
An ecmrla ims tt^ occaaional e^loyment the Project A^isfc #ides in a ' 
TOp-imm^ctional capacity at project ^ schools/ This'TOCurrence WSiis comider^ 
to reflect a fundomntairand complexi problem in coordination between line 
and staf^. district personnel. ^ * • 



m i xed lytporx* On the positive i^ide,^ Project staft rnuberA seemed to be .ner^ 
forming duties appropriate to fheir roles # Aid once staffing reacbiki tbm • 
proposed level (in January ^ when the n^ Staff Develofn^t^Specialiiit^was 
hired)\ project smnagement seaaed to shift from a crisis b^ientfd^^proach 
to a more systematic one/ * , ^ ; 



gram« In previous years this monitoring nmkA^pM hf evaluation mpktti This 
^ year,^ funds were not provided for evaluation to perfoijim the mo^t;briiii fm^c^ 
tion, nor was the dut;y clearly assigned^o one management position* The ex- 
pectation seemed to be that the Project Codrdinator m:^ Staff Development > 
S^ecialisixahould make occasioi^I classroooT mcmitoring visits. • 4bccording to 
the eval^ati^n consultant 's^^r^ort, very few classroom^ visits w^e ever made i 
Several of the teachersAif^erviewed by thia consultant reported that tti^ir 
greatest criticism of ihe project \was project management's lack of support * 
to ttiem in organizitig the instructional process. 






DECISION t»UESTiONS ADDRESSED. 



•lllTHODBCnO« - ; . • 

Xn proper context^ the decision questions for an evaltmtion^atjr « 
f otaulatad Jiy-'the d^cijifion Aaksers Utivolvedi. with t6chlli^M' 4^«i«-* 
t«nt€ frop the evaluftipn staff during the« design «^^iMe of the 
avsluatioii. '-^EvsXtia£ion then serves the decisioa-HUking process by 
--p^^idl^ Inforution televant to those questions and assisting 
ti^Sf^i^riate oadninistrators to arrive at a recoienaittioa c<m- . . 
ceraijbig ti^^eci^ion^ Ultimate respcmsibility' f pt vak^ the de- >^ 
cisions aluays^ests with the partfcul^r decisioii-aakgrs charged ^ . 
with that responsibility. ' - N ' ^ ^ ^ ^ 
^ A ^ - ^ \ V ' 

This /section of thi repoirt provides a sudoajry^pf the inf oration 
•copl^iMd in the re*st o^ the r^ort.v For noire\diM!ail tnT the findings^ ^ 
rq^ted heret refer tovtl^' other se^ions of thjLs * report irtiere the* ^ 
' findings are presented 'in greater detail. In.iiost cases, page/ 
referenc.^js are provided for ttie detailed findings. 

/♦ • • " . * • ^ ' • . - • 

FcMT.ti^ 1975«*1976 .%chool year a different pfocedure hsl been adopted 
f^sN^ing the teconeeiidat ions. Formerly » the ORE staff sade recop* 
Mndations based on their perceptions of the evaluation findings'^! 
This yefr the policy adopted.in AISD is for OBE to prbvide the re^e-, 
vant dceision*-aakers and administrators £n the district vith^a cq;^ 
9i the decision questions and evaluation findings. These administrar 
' tors will have responsibility for making recommendations i^ich will 
, be forwarded ^to the Bbard of Trustees along with the finsA report. 

Special Note • • ^ 

^ This year» the evaluation information collected on BSAA Pilot Pro- 
ject Assist by the Office of Research and Evaluatioiv' wa^imited to ' 
outcome information^ on the enoT results of project, activities. '* 
Because oatcope evaluation information is by d^efinition pr6vided 
only^ at the end of 'a project year» and because proposals for federal 
funding must be submitted in mid-year i an evalu&tioxr of^ the sort ^ ^ 
ifone for Project Assist this year can provide little timely infor- 
mation fox^ District decision-makers in planning^ 'projects for the 
coming ytfar. * . * 

Aa a rctsult of this limitation^ a number, of ^he decision questions 
formulated for 197S«-76 Proji^t Assist have essentially been answered^ ' 
for 1976-77 > without the benefit of evaluation information from^he 
present year. And in fact tjie ESAA' Pilot proposal for the iu>miQg ^ ' * 
year is considerably different from the 1975-76 proposal.^ ^/ 



Vxnmwn^ .tl|« infomation i^ich va's callect<^d felevant- to thoae ' ' 
quiffb^^llpa is repottad h^re atul decision-nakers^ hrp aakad to conaidex: , 
'it* ainca ao«a o^tha X975-76 Project Assist coii|»onanta ara '^ontimied 
/in tba 19^6^77 propoaal; atid aiiice 'future* programs may conai^ar * 
othar CMpdnabta aiadlar tp'thgaa in 1975-76 Project Aaaiat*^ i 



Iffiara appro^i>iatei infof^^ation on projecjc inpleiRaxitation fapolrted 
hj; thit outiiida consultant a* ia ins^ludad Jbi the^aunna^ q£ relevant " 
da^ ^loiTv fiovaven, tjhera ata ^ mmbai; of liaitationa in tjij^ 
Mt^otfa iiaa'd to e<^llact this information, aa V^rtad. in ^ptar IV. 
.T^afota, thia infomation can be cbnaiderad aa' only auggaativa^ 
of Actual program. £v^ts* . - - ^' ^ 



yfST8lt-lEm QUESTIONS - ^ . 

1. Should *ithe program ba conyti^ued in the District? 
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RELEVANT FlN0IN«3S: " C * > - * 

h4 Project, itead and Proj ecu Hath :- ' Outcome* data , collected by 

the Office of Research^and Evaluation .^ahona^hat math 
^ achiavemant and attitudatf' tOMard 'math did not impwoye ^ ^ 
r as a result of Project iuth. (Saa i»agaa 31 'and / • ^ 
32 « •) Reading achieuan^nt alio failed to show 

any over-all iji^rovasent • '(Sea pages 29 and. 3p )• ' 

Bacauaa of imda^uatf fuhding, w/cTMarocm obaarvatiQnp ^ 
vera macia by the ^vaj^a^or to 0tatmina hoir the aidaa 
worked with teachera atui^ a|^aln:la, hov project lute^la ^ 
were employed, or the ^i^x:ee of ii^Xamitetation of^^ fijro^ 
posed project cup:icul^« The dontractad conau||ii»t*s re-r 
jfottt baaed on. fnterviewa with some j^tolect pp^i<^ipant^, / 
in^icJatad that ^ot the moiit partly; aidaa i^ra tytaed instruct 
tionally, but that aides>*£^ teichars rateived very little^ 
' inservice trailiing (pagei 56-^ j 87-88) v 'Th^ curriculum 
specif iIkU in the project proposal fot' ireading and ma|^ vajs' 
largely unii^^leme^tedt with the'nception of '.the reading^ 
labs at ^rtin» which were in operation- thr<n^hout the y^ar 
(pages 55-56^ 61^ 78> 86-87), V ^ ^ 

bi- Trilogy ! Two Trilogy perfomanic^s were hild at Broject 
Asrfiat schools, (pages .33- and 136 ) • (ioXlected 
by th(^ Office of Reaeihrch and BvaluatidA at those - . 

' per^oriMncea ahOwed that Aastinj ,;ndepa»dent School' 
DiaJricC tacfliy and staff who vitewed/perfoirmances by 
the Trilogc /troupe Veite' generally able to discern tia^ or 
Trilogy goals. (See pageo- 33-35 T- They were also 

J enthusiastic about this success of Trilogy in meetiigj 
these goals. (See pages 3f6 and "37 ) ' . 



However, it should #b'e noted that jas rctported.1>y the out- 
aide conaultant^ Aaly a a^ll portion of * the Trilogy t 
conponent pi?9^ds^»€or Project Xk^iaC' thia^ year 'vaa ever 
ii^plettented.- The cbnaultant^a aid-year - report on TriXofy 
ijq>lwentation xjodlcated tl^^^^ sodel 
had not y/et becji iutpl^enfed/ nor liad Project Aasiit istu- 
denta been Vecruite^ " f or< memberahip in Trilogy.. . 
(Seci pag^a 113 and 114 )• ^The end of the year ;repc)!rt 
indicated ih^t in ^P£iljf or a tttiatber of teaaona diar 
'ci^aed 'in tba^ report, the Coordinator of Proie^t'Aaaiat 
hatf requeat^ and ol«;^iined per»isaion froii the^BSAA 
Regional Progrwt Offlcier jt^o conaidereVly reduce the 
ac9pe*ojt TrUogy thia yeeV ^ The eom^nent iiaa be 
liaited to a t^eacW traininj^'^iiodel. TM^4ie^t tjult" 
fhe itaff )iDul(| -mak^ ncf'atteBpt' to recruit Project J 
Aeaiat at&ateata to|t>e Trilogy c^tat veaM^i >hia yeat. * 
NorvQiild a^ 'performtncaa be belt jfbr patedta of >atu- 
denta in Project Assi^t^ schoolsi \Sb^ P«ge 152) # ^. 

^though Trilogyxdid not achieve its pirc^Kwed gpala for 
iapjtement^tion tMTi^year, an event iiidicatis^ Trilogy^ a 
Btt^ appearand '^bi^ential f^r |tkpn(l^ occutred at Mi^rtin 
Juniior digh* follofving the tsi^rforaenoe tli^re^ a tea^bfer ^ 
wKa waa a former Trilogy cast member decid^^on her otm 
initiative, to form a Trilogy^like troupe 4C Hatt in* .Sh% 
aiucceeded in *d(».n$ 8o»\and thia apin-dff wi^, named / 
"Edstside Exp^reai/* A^ter formiiig thjia groups the J 
teacher«contacteid maqbefa of the Trili^ it«fC^ to m«k^ 
fj^r aaaiatance.^ de>:;ided tatudce availible^to 

thin group the conmiltanta that were provided' throu^ 
ESAA funding, ainj^e the group wa8^ serving m^m. of^ tmi *^ 
needs for whicb^'funds had been granted^ . ' 

. r . . |_ V . ^ 
Project Qntreach ; . Outcome 4nfotma£i6n.42oll^ted by }:he, 1 
Office of^Research and Eva^uatiotn indicted that f acuity <^ 
familiar wA.th' students referred -fdr Project Outreach 
felt that about^ half of the students «had improved :xn' the 
areaa for whibh* they wi^re ref ertedf^(See p^fs 39-41 ) 
In a largchmajbrity-of the cases, iihere l^^ovement waa ^ 
shown, faculty- meqib*rs telt the Project "Outjrfeach interna 
had contributed toward 'that improvement. Even in adme 
caaes where no improvVment iiaa shown, facult/ credited 
the^internp wit(n h^lpin^ ^somewhar^, (See pages 39-41 ) 
The^^contracted xonsultaiitU report indicated '-thuf this 
component had be^ implemented 'essentiall; es proposed, 
although some probleins and a'dSitional areas of fo^ius were 
Aotedl (See pages 12D and 121, ^^utW-lSS) 

HECOHMENDATIONS:; • n * 

This year^ reconmendations vill, bci made by appropriate ^ 
administrative ataff. , o ^ 



• ♦ ^ 



2. Should Austin Independent School District aides be used as 
instructional aides? >. 

RELEVANT FINDINGS: 

Achievement scores in reading and math did not i]iq>rove overall In 
Project Assist schools this ye&r as a result of having 
instructional aides in the classrooms. (See pages 29^32). 

Contracted evaluation reports indicate that there^vas some 
mixture of aide duties at the school level, sdch that Pro- 
ject Assist aides were -assigned^ their duties^a addition to * 
instruct4.onal duties » and that 'aide morale may have been 
adversely affectjed in such cases. (See pagCF •''^ -^^4 55, 82-86). 
Spctcial training for the instructional^aid . -air was 
apparently limited to preservice ^raihing» aoathly 
workshops for aides beginning in January, tPages 56-58, 8?^, 88, and 93) < 
Apparently no training sessions were geared specifically 
toward teachers or both teachers* and aides. IMs scarcity 
of training, i^ich was related to Project Assist's lack 
a Staff Development Specialist for much of the year, is a . 
potentially serious problem in the employment of instructional 
aides, since evaluation findings from previous years it^icate 
that while the presence of trained aides promotes indivi- 
^dualiieation in the classroom, th<;^presettce -of -untrained aides 
seems to decrease individualization. (See 1974-75 Filial Re- 
port, ESAA II Project Assist, p. 3). The explanation^ 
for thi's seems to be that untr ained aides retire a sub- 
stantial degree of guidance fr<nn the Ceacher. 

RECOMMENDATIONS: ' ^ 

This- year, recommendations will be mjide by apprdpriatc 
administrative staff. 
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. FE DERAL-LgVEL QUESTIONS 

1* Should the program be refunded?* — . • 

I* 

RELEVANT FINDINGS: ) 

Federal deciBion-makers should consideir at least three 
factors in deciding whether to re<-fund Project Assist. 
In making decisions regarding the project's current com- 
l^onents, decision^mal ers should consider the degree of success 
in achievement of objectives for each 0f the project cdm^ 
I(oa&nts..'The decision-makers should also consider the»r^«* « 
latj^ve cost of the various program components, finally the 
fq^e^al decision-makers should consider factors within Austia 
ifnd^pendent School District which influenced the adminis^ 
tration*of federal funds for Project Assist this year. 

* / ■ 

De^iree of success 16 program implementation and achievement 

of outcome objeglfives, 1975-716 : Information .relevant to the * 

degrea of success in implementation ai!d achievement of ob- 

. jectives fp^ each of the project components is contained in 

the section on findings for System Level Question 1. 

(See pages 5 and 6 }• In general* these results indicate 

that ^oject Read and Project Math were implemented to some 

dcrgr^e: materials were ord^re^ and aides were in classrooms* 

However » the proposed curriculum was large^ Unimplementsd. . 

Very little training was provided for aides, none for t$eachers« 

Reading and math outcome achievement goals were not met. 

Trilogy did not inc<^porate Project Assist students this 
year and did not 'provide the number of performimces pro-;, 
posed for Project Assist schools. By the close of the year, 
a start had been made at developing a teacher training model 
and at collecting information to help expand Trilogy to the 
elementary level. Trilogy -had met two of the outcome ob- 
jectives set for it, which specified that audiences would 
perceive Trilogy goals and see troupe memh^ers as pursuing / . 
those goals effectively. Because of lack of implementation 
.flp of this component, no inforsiation was gathered ^ change in 
-^y^ interethnic attitude s ^ among Proj e ct As s iot Trilogy memb e rs* — 

Project Outreach was implemented essentially as proposed. 
Its outcome objective, cotlcerning teacher ratings of im- 
provemeiit in referred students, w^s met.^ ^ 



Cost of program compoixents : Funding appropriated for. Project 
Assist this year can be roQghly broken down into the following 
components: Central administrative and clerical' support 
services, funded at $28,567; Project Read and Project Hath, 
funded at $293,400; Trilogy, funded at $1750; Project Outreach, 
funded at $1426; and Evaluatioi^, funded 'a€ $10,056. As 
can be observed above, the bulk of funds were allocated foi; 
Project Read and Project- Math. The major items Included 
$147,200 for instructional aide salaries and $98,824 for ' 
instruct.ional materials and hardware. The salary and support 
' . services of the Staff Development Coordinator are included 
\^ under ?rojects Read and Math, since the duties of that po- 
^ sit ion, as described in the proposal, were limited to those 
components. Trilogy \9as primarily supported out of ESAA 
^ Basic funds^ so Project iSsist received fxinding only for — 
Trilogy consultants and their travel expenses.* Similarly, 
> P^ject oinr^ch was^ coordinated prii^grily by a faculty member 
/ from^the University of Tteas, so Froject Assist provided 

£und8 only for intern travel, mati rials, and staff training 
consultants.'^ * , . 



decision maie regarding refunding these components or 
similar ones in the future, should consider their relative 
cost, balanced "l^against their* actual (and potential) degree 
of effective implementation, and actual and potential 
success in producing meaningfi^l outcomes for students. This 
year the bulk of ESAA pilot money was Spent on Project Read 
ancT Project Math. Some of the siore difficult aspects of 
these components were not implement^,* and) the components - 
'failed to achieve the hoped-for student outcomes;' ~ ~ " 

Trilogy Had Telatlvely^ small firndiAg. It was largely «^ 
uttimpl^ented, although there were Indications it had * 
potential appeal and could be readily implemented given ' 
sufficient personal investment, by those* responsible for it. 
It^ successfully met two fairly **easy" outcome objectives 
demonstrating audience support, but its potential as a 
vehicle for attitude change remains untested k 

Project Outreach likewise received comparatively little ESAA 
mbney (being funded largely by a NIMH grant administered 

throu gh th e - Univer si ty of ^ Tex as ) . — H owever »^ xt^ was a pp a ren tly 

%rell impl)emented in project schools and it did achieve an outcome 
objective based on at least perceived benefit to students. 

♦ 

Project Context ; Some of the factors influencing management 
of Project Assist this year wens not within the control of 
the project management. These include the la6« release of 
'federal funds and the resignation of the previous Project 
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Coordinator with the ensuing vacaney» in the Staff Development 
Coordinator position. (See page 

Other factors iTivolved" coordination with District personnel 
outside* the prqfject staff, and it was not clear the evaluation 
cpnsultant why the problems seetuad so^^istant to solution. 
An example was' the assignment at the school ^evel of Project 
Assist aides to tasks whidh violated the objectives set 
forth in the' project ^proposal. (See page 6-10, and 92). 

In t^rms of factors solely within the province of the pro- 
ject management, the consultant gave a mix^ report. On ^ 
the positive side, j;>roject staff members seemed to be 
performing duties fiipproprxate to their roles. Also, some 
functions lAich we*te lacking during the f irs|, part of the 
year^whexTthefproiectTias under-staffed, were present during 
the latter ludf. One ?such 'function was a systematic approtch 
to management, (rather than a ctisis-briented on|5ryith plane 
being foTiiuIated to overcome in the next project year some^of 
the persistent problems which were experienced this yijl^* Oh - 
the negative side bf the balance » one function which seemed 
to be clearly the'^ifesponsibility.vof project management this- 
year was reportedly ^ever adeqtSately peritorted, seemingly to 
the detrimejpt of the program. This duty consisted^'of monf^^^ \ 
toring the implementation^ of the project on the school levelV'^ 
with the goal of catching am} quickly resolving any problems. 
Several teachers interviewed by the consultaiit ilpontaneously 
commented that this greatest shortcoming of the. project, in their 
opinion, was lack of program suppdrt to teachers in organising 
the instructional process. (See pages 79, and 90<-92)« 

A decision to re-fund this^and other'simi^ar programs., in I'C' 
Austin Independent School District ii^ the future should be. 
based on an appraisal of the probable effectiveness uiih 
which^such funds ran be expected to be managed. This^judg- 
ment should be based in part on the effectiveness of t^is 
year's management, weighed against the factors beyond its 
control with which this year's management had to Contend. 

RECOMMENDATIONC : „ , 

_J!hlfi-year^-.r^ommcndations wiJ.L be made by .appropriate 
administrative staff. \_* 



Should the program be evaluated? 



RELEVANT FINDINGS: 

Evidence in favor of Evaluation: If programs are to be held 
accountable for delivering the services and outcjomes proposed, 
they should be evaluated. Input and j>roces8 evaliiation 
data provide Information on how veil a program is being inple* 
mented* In the forsiiLtive stages of a progrip* this is the most 
vital type of evaluation information to collect, sinde studies 
of innovative programs indicate that program implementation is 
'a complex process, requiring mutyal adaptation betneen programs 
and their school settings. Vei^ often programs fail to be 
implemented at all, and program evaluations turn out to be 
evaluations of "non-events."^ 

This year, funding was not sufficient to provide for monitoring 
of classroom processes for Project Assist; Therefore, Tittle 
information is available on what the aides &ctu%lly did^ ? 
or how well they did it. However, the outside consultants 
gathered important interview information on the degree of 
implementfation of priogram components. For-instanciS,'^ it was 
reported that large portions of the Ifrilogy, component were 
never implemented, that ^he curricula propose .for Ptoject 
Read and Pjroject Math vare largely ilii. tbpietfented, and that aide 
training was minimally implemented. 

Summative, evaluation data on program /outcome objectives and 
evaluation questions provides infotmatid^ on whether the pro|;ram 
achieves the goals set for it. Furthez;m9re, having to report 
such information f orcejs program plaxmers to thln|c in terms of ' 
desired outcomes, a pattern of thought perhaps not as automatic 
as one might suppose. 

Havitig both types of evaluation data may give information on 
si^nif icaxtt components which help a program dichieve its goals 
or, when lacking, keep a program from achieving its goals. For 
instance, it was suggested by the firj^ two years' evaluations 
of Project Assist that lack of sufficient teacher and aide train- 
ing may have been a .significant factor in the failure of Project 
Assist to ever meet its goals for improved student achievement. 

Evidence against Evaluation: Because of the time required for 
designing instrument^, administering them, analyzing data. 



^P. Berman, and M. McLaughlin, implementation of educational 
innovation. The Educational Forum, 1976, 40 (3)i ^45-^320. 

2W. W. Charters and J.E. Jones. On the risk of appraising 
non-eVeots in program evaluation. Educational Reaearcher . 1970, 
2 (11), 5-7. 
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and 'writing up results, it is difficult to provide evaluation 
information that is both thorough and timely. For instance, 
since proposals f or,, f edeirai money must be submitted at mid-year 
of the year before funds are-sought, evaluation information 
from the current year of ongoing programs is aeldom available 
to help in this ,pFoposal planning process. Furthermore, results 
(especially negative ones) from the first ^ear 6f a program's 
inplementat ion are generally not considered conclusive. There-* 
fore» there is an added, year's lag cime before mnequivocal 
outccMie information (based on two years* fiaidin^) is available 
during the project proposal writing phase. This means that 
> projects may be funded for as many as three years before- negative 
evaluation findings haye a chance to influence project detign. 
Even when two years' negative results are available before funds 
£ire a(ttually received, sctibol'd^trict staff re^onslble for 
writing .bf proposals and f ^eral petsopnel responaible for review 
of , proposals mo^ be less t]ian eager to co|fisider revisions after 
preliminai^y .^pproval^^s been given. . . 

Such was the case with Project Assist this year. In February 
and Harch 1975, a proposal for 1975-76 whose major treatment 
was essentially like the one fr»om the two previous years was 
writteii and submitted to the USOE; Ifi Aiyril, wwd .was received 
of approval of the project as proposed. In itay^ and Juhe| wiien 
1974-75 outqoitie evaluation infct^nation began taking shape, . 
,the project's Evalua tor informed project staff of the negative 
results and advised making a changd in the proposed treatmmt 
for the coming year. . Program staff indicated t^at commitments^ 
had been made to schools concerning the project for 1975-76, 
and therefor ; .they did ndt want to make changes in the plans. ^ 
funding of the 1975-76 project, wsis to have ^egun July 1, but 
was held up byx^t|e Office of 'C^yil Rights l>ased on district 
non-compliance With sobte of its^teg^ilations. Funds W6re not 
in fact finally released/until the beginning of September. 
Duritig the two-month hiatus between the June 30 end of funding 
for 1974-75 and the September releaae of, funds, the Evaluator 
proposed to the USOE Program Officer and to Project Assist 
management that the proposal be altered. Again, the response 
was negative because of the trouble that such a change would 
hfve involved. 

The solution to problems in the 'employm ent of valu atio n 
inf o r mation Itke The one outlined above is pot readily apparent • 
However, it is a fact that over $900,000 in federal money was 
appropriated to Project A*Bsist over a three year peftiod, add 
the project never achieved its primary goal of Improving student 
achievement in the project schools. 



RECOMMENDATIONS: 

This year^ recommendations will be made by the appropriate adminl^ 
stratlve staff. . ^ 
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PROJECT DESCRIPTION 



A.. raOCRAM DESCRIPTION 

Hiitorical Ovcrvlev: Project Assist 1973-Jy5 

This year 4i(a8 Project Assist 's third year^ of funding acf.BSA^ ' 
Pilot Projeii^t* Frco 1973-75 its purposejwas to test the following 
hypothesis: 

Students\vho are in contract sfith teacher aides nho have liad 
specif ic\ training. in the area. of reading instruct^bn* idll 
leitm tolread better than students who are in contacl^^ vlth 
' teacher slides Who* have had no readii^ trainings and also better 
than students ^AiO ar'e in contact with no teacher aid^s. 

The 32 experimental aides received specjial prepervice. trainj^ in 
reading U^cm prograb staff » as well^ as on-the-job trailing frcn 
teachers with irtion they worlfed. Materials vith iihlch the aid^ iforked 
were a key i^eature of the program. Instru^ional Materials wer< 
selected by the facultfes at the prbject spools* 

The original design included thret^ ^eriottntal schools vhich . 
received specialiy trained Project Assist aidei^ three con^risoh 
schools which received g:eneral classroom aides j and four conttol 
schools which h^d no aides at all. The esi^efiiiental schools dvring 
the first two y^ars of the project' weres Martin Jimior High, grades 
6*8> Mejts Elep^ntary, K-5» and Pain Elenentaryr K-S. 

' 7' ' , - ' . 

This Yealt^s ^P^ogram: Project Assist 1975-76 

^ - /: ^ ^~ ^ ' , ' 

The program for 1975-76vwas changed; Both^the genferkl kide and 
no aide controls were dropped f ron the^ design/ 'The instructional ' 
aides and their training and ttaterials used i^re i^ain to be a 
major part of the design. However, several new components w ere 
added Xo the original^ one, ^ie4^ f^)cus^ on ^q>rovemrat - of^ reading 
skills and attitudes. ^ 

This year's proposal called for a math progitip paValldl to. the on# 
already existing in reading to be ^tailed in ifartin Junior Q^gh 
School. There was also a co^>onent called Project Outreach iMlch 
called for social work interns from the University of Texas to work 
with children ri^f erred because of behilvioral or attitudinal problems. 
Trilogy was another new component, irt\i!ph employed a tri-ethnic 
school-community theatrical troupe to portray student «tea4her situ- 
ations in a satirical .fashion to '^illuminate pressures, problems, 
ind positive encounters in a humanistic way.** The components of 



Project Assist for 1975-76 are described in detail later in this chapter. 

Noisily vas the program content diversified, but the target scfhools for 
prog^ Iffplioentatlon were changed. This year's target schools Included 
all ne« schools on the eleaientary level: Sins » Oak Springs and Rosemod» 
vlth grades K-5 receiving fiervlces. The junior high schools Included 
NartinVyiAilch vas continued as a project school from last year* anc^ Allan^ 
which rechived expanded servlcM.^ As atated earlier » the ccmtrol and 
comparison schools were dropped* from the ^design. 

rundin^ t ESAA III Pilot Project Assist wa^ funded at $3!35,199. Ibis was 
an jj&creMe from the 1974-75 funding level of $283 » 560 and the ^973^74 
funding level of $297,798. * \ 

Table III-l: BREAK-DOWH OF FUNDING FOR PROJIRCT ASSIST COMPQSEHTS 



Cost 


Program / CotqMment 


$ 28.567 


AnhBlnlstratlve 


293,400 


Reading and Kath 


10,056 


^aliuMition • ' 


1,750 


Trilogy 


1.426 ■ ' 


Outreach 




335.199 • 


Total • . 



Ftrnding for Project Assist can be roughly broken into five cati^or lea as 
shoim .ln th« .table above. Approximately 7/8 » pt almost 90Zt ^£ the pro;ject 
.budget was ^pent on the Jteadlng and Math ccaQK»umts. This ampunt* $293f 4i00» 
Imcludea $147^200 fbr instructional^ aide salarlM and $98 , 824 for instruc- 
tional materials and hi^rdvare. In other vords^^ $246»02A irayi piqrslcally 
preaent in the Project Assist classrooms. The s^ary akd support costs of 
the Staff Develoiment Coordinator are also Included under Projects Read and 
Math elnc^ that position was limited by the project proposal to working 
with those, components. In Contrast » Project Assist received^ funding for 
Trilogy only for consultants and travel* the remainder being Jfunded but of 
ESAA Basic. Project Outreach was operated by a University of Texas faculty^ 
member and Projecr Assist "provided" modest funding for Intern travel*. ^ 
materials* and staff training. « 



Staff: The 1975-76 program desfgn called for professional staff to include 
a Coordlnatof^nd a Staff Development Specialist; the piraprofeaslonal 
staff was to include 32 Instructional aides and 2 secretaHe^. Funding w|i8 
also provided for a half-time- evaluated » whose .duties will be described in 
a later aection of this report. 
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Project Componentfl ; There were several components to this year's project I 
The descrtottons belclr reflect the components as they vere described Ixi 
the project proposal, rather Jthan as they evolved over the course of the ^ 

!£§£• . ' ' 

Aides : As in years pest» in^truational aides once again formed a 
major part of the program's design. ^ The goal in hiring the aides wad ^ 
to supplMmt the efforts of the teachers in providing individual 
assistance (In reading or piath, as ascplained below) to low-aehleylng 
students » as well. as in providing adult supervision. 

The project .proposal called for aides hlted from the sch6ol neighbor- 
hood and/or mliiorlty grj6upt:» who would be extensively trained in 
specific subject areas/ as well as in classroom managemMt t^dmlques. 
Tvalnlng was also to focus on cultural awarttess> htin^ relatlonSj and 
communication skills training » in ojrder to prtowte closa relationships 
Mong aides » teadieri^» and studmts. The training was to Include Ia^ 
tisnsjhre summer preslkvice training ar well m a thfM-day training » 
session immediately^ before the start of school » whlcli would also be . 
tended by the leachers. Once school was in session* training for 
/ aides and teachers was to continue throughout the school year* 



/ 



It was specif ie^ in the proposal that the «aldes would perform only 
ins t national (as opposed to cleric^al} duties* At i the elem^taty . 
leveli.they w^l^ to work only on reading' tas^. ^; At the jia^r hlgli 
level,» ^they ifei^to work only on reading except at Martin, where they 
were also to work on math instructional .tasks In support of Project 
Math» a sttbcoivonent of the" project. ^ 

Materials Materials provided by Project Assist were also ijottended to 
be a major component of this year's program* *Jteadiiig and mathematics/ 
materials were to be ordered fot the Project H^mlk and Pro jact Math 
componltots delbrlbdd below. c ^ ' 

Prpj act. Read : Project Read was to Include aides and materlaJ.s, as 
well aa the following curriculum components: , (1) "Reading Is ^ 
Fim^damental" was to be offered ax the second or third grade level, 
TMrough this progrsm» students were to^ be furnished with a minimum 
(^f four paperbabk^books of ^ their choice » which they would be allowed 
to take home and keep, (i) There wai also to be an Oral Language 
Development component which was to use resource persons and materialk^ 
to increase children's exposure to lai^guage learning situations. 
Materials were to include listening stations- htiblUf tapes # re^rds» 
and audio-visual materials. (3) The^Language Experience Coq»onent 
was to^ pi^vlde children tke chance to become ''authors*' by creating 
their own stories, either Jby dictetlng them to an adt^lt^or by writing 
them thmselves* The stories could then be edited, further develop** ' 
ing language skilliB. The students' stories were to reflect current 
topics in the various content area^. In social studies. Bicentennial 
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Stories centering on the contrlblitions different ethnic groups 
were to be encouraged* <4) A Progranne^ Instruct ion coapcment was. 
also planned for those teachers who wanted their students to follow' 
a caref^ly sequentlalized course of study. 

On the Junior high level, it was proposed that readlng^lnstructlon 
follow a laboratory approach • The reading labs welre to have teach*- 
tng nachines; progmaed reading instruc]tiou; coBq>rehension» oral 
li0iguage» and language estperi^ce components. Langufcge and phonics 
progrsM were also included. 

Project Math ; Project Math at Martin was to be designed around a 
nath lab setting parallel to the Martin reading lal^supported by 
SSAA fimds f ron the previous two years** Sl|^» sevmth^ and eighth 
grade Students were 'to be served. Hie projected ^^supoiients i^re: 
(1)1. Readiness in Mathematics » to teach imdera#itevisig students * 
basic math concepts ,^by dlicov#ry. (2) The Conputattonal Sldlls 
component was to^use s pro^ammed leamlug tpproa^ to tsfa^^ coiipu* 
tatlcmaZ skills in addition^ subtraction/ mult^3Jcstioii| dliduiiofi* 
fractibn8» and 4e&imals. (3) The Problem Solving/Leigic^oaQponent 
was to apply computational skills to real life situati(ltis» iislng a. 
graduated difficulty » programmed apptQach* (4) l|iE^m l^th^ as 
described in l(;he*^pibgram,|>roposal» w^s^^^ t^^ «q»|iasis^ studeut dis<^ * 
covery of mathematical prVteras*. This c<»|Knient was ^o be 
implemented fo^owing coiq>letion of/the'coi^utational program. i 
(5) The Math in Life component was to feature classroom vis&s / 
by business and civic leaders as well as highr sc1k>o1 and college 
students. The visitors were to emphasise the iq^prtance of math 
skills at higher educ^ticrial levels » in the home» and in 
business. * ; * • " 



Project Outreach ; Project Outreach isj the social work component of 
Project insist. As pj»it r»f this compojnent^ approximately ten gr^uate 
interns from the Ikiiversity of Texas «itlAustlA S^ool of Social- j^ork 
were to be placed in Project Assist schbois to wcjrk with childr^ 
^referred by sdiool personnel. Possible bases' for referral were// to 
include habitual truancy or classroom atcitudinal or behavioralV prob*-* 
The social work activities were to include work at individual/ 



lems. 
group. 



family » and organisational ^evelsir 



One of the social wotk activities proposed for the year wais ij^divJdual 
counselii^ for children having a hard time Miusting to the f chool 
setting. For very young children, it was anticipated that s^h h^p^ 



might include play therapy. 
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Some children were to b^e helped in groups of various types w Among 
then^were cluster gr:oups for scapegoated or withdrawn children, 
activity groups for children who need tb see school more positively, 
discussion groups for children who need to develop verlfal/ skills, 
and leadership' training groups f or children who need to Wave natural 
leadership ability charneled into more constructive activities. 
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ftfilogy : Trilogy Is. a trl-e^nic ' the-xtflcal troupe d^eloped by. • 
th«Al974-75 ^ESM Coimmity tialson Program. It is c^oq^osad' of ^> > 
studWitSt faculty > and staff of Austin Independent S&hdol District » 
Maafear* of the troupe presdnt original skits porfttayii&^students 
and. teadiers in various pressures-related* situations*- Qa * ^ 
portriqral6 are satirical in tone. . The aioi is to **illuBinat^ 
preaaurer» problens> and positive encounters in a husanistlc vay/*^ 

PlMiis for 1975*^76 called for Trilogy to. develop* a teacher training 
nodel dealing specifically with claslirooB sttuationr Incident to 
Project Assist schools. This plan vas to be developed vltb^ input% 
from Trilogy consultants. Project Assist staffs ^ teachers* In 
addition to dealing with real clasaroom aitoatltma, the aioid^ vas 
to focus oh teachets* attitudes and actions In deeU^ itttii the 
skills and language and coimtnicatiLon patterns of stui^tttts. 
Performances were 'to be held duriti^ preservlce teachir. training.. ^ 

Petforviances ver^ also proposed to be held quarterly at Project 
Assist schoola and at least once for each Project Assist school 
PTA. ' Trilogy activities were intended to pmote knoirle^ge^and 
appreciation for interracial and interethnic culture^ hlatory* 
and characteristics. ' ^ ' * ^ • 

There were also plana to include stt^rats from Project Assist 
schools es Trilogy members this ipear. It was hoped that parti^ 
cipation in such a troui^e would ^is4>rove ii^erethnic^ attitudes 
and relationships for the n^snben. , ; ^ ^ 




IProm T^logy d^acription In amended 1975-76 ESAA III ' 
Pilot Projeet Proposal* Page 12. 
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Thi|i auction of an evaluation report, from' the Office of Beaeatch and 
Evaltti^ion cuatoaarily reports on the ccirepta surrounding a pi^oiect' which 
happM prior to the start of' the project*" or during its operi^ion, 
irihich are outside the control of the project and which have/an .i^^luence 
<^ the project* s ii^plenentatioh or outcoiM|L / 

The factors discilssed here are not preaented as an eaduuistive list of 
those i^ch iapacted Project Assi^t^ thls«^ye^r^^hutvsiq>ly as a record 
of i^ste of theysajor events^i^ich helped sha|ria the project^s cpurae 
thii^ear/ leaders interested id fitiding out irtiich events fe^Md iil^<^ 
ficimt^o the Project Coordinator are referred<to a libt prepair«4 hy^the 
Goordinftor following the j first process and aanagettent audit. ^ l!he list 
is eotttaittiNl ix^ section I^Hl of thiir r<^«t. 

(tee event which continued to have" a sajor ii^pact on the prb^e^^ through- 
out the year was the late release of federal fu^da for the projWt. # * 
Accor'dii^ to* the Project Coordinator^* the ^ela:^ ipM caused hy the 
Austin Indepmiji^t School District *s non-coi4>liattce^with regulatiOna of 
the Office ^►f ^ivtl Rights. (See page 157 - -.:i,^^The chtronblogyp' 
repbrt^h^the contract^ consultant, ae f ollows: Ii^^rMal word on 
the approval of the project waa received' ad early aa June . 1975. Forttal 
approval was not receive4 until Augunt 1975^^ and f^a were «lbt releaa^ 
until Septenber» (Mint er ^ p/ 110 ). ^ , , 

Th4 lateness of fundi^ for this ^oj^t waa particulptlyi significant, 
since an important aspect of .this year's pro;} act was training to be held 
for aidea'ind te)Achers prior to the start of' sahool. The fundiiig delay 
also postpofl^ the ordering of inatructional saterialay which wjaa to ' 
have taken place in July la)Qd/ August. (Following'' the reaigiiatio'n of the 
previous Project Coord inatoif'-^see below*the new Coordinator wde a ^ 
deciaion to involve District* Instructional Coordinatora and Project 
Aasiat faculties in select ii»n of this year's aat at lala^ Thia decision 
further delayed the ordering and hence the receipt of project materiala.) 

^A second najof evrat which bad an jiipact on t^he projett was the resig^ 
nation of Uie Project Coordinator frca the, previous two years, on Sep^ |. 
tefld»er 8; 1975. At that time, the, Staff Development Cpordinatot took 
over* as AtftiTig ^oor'tinAt^oy frnd co ntinued t o hold bot^ positions Aintil 
she waa officially appointed^ as the new Project Coordinator in Octdber. 
The new ^taff Development Coordinator waa not hired until January 19, 
1976. This meant that one person was filling what were intended to be 
two pofitiona for ha^f of the project year.* ^ 

A third element in the project's context had to do with the lack of a 
clearly defined responsiMli'ty' for monitoring projecr implementation. 
In the peat two ye^rar-^he Of fic^ of^ Research and Evalua^on had moni-- 
tored processes in program implementation at the classrooiil level and 



18 

Z4 



Tttported cm them to prol^ct staft»-and to others as appropriate^ this ^ 
year» the monitoring fUhctlon. of evaluation was not funded to evaluatioi 
nor waa. it clenrly aasisn«d to on6 position, although the ttpectation 
jSMMd^io be that the P»0ect Coordinator i|Qd tlie Staff DeveXojpmt 
Coor^l^ator^ should sake occasional dasatoom observations as part of 
their duties. AS reported by the outside consultant*, lioiiever, clastroon 
observationt ifere. almost none]iti8 tent, and i^en made were focused solely * 
on the instructional activities of the claasroori instructional aide. 

A final problem in the context of Kroject As^ia^this ye^, according ^ 
to Jihm contracted management auditor"^ for the project, involVa^ diJ^f i- 
ci)lties in high-level coordination between project staff and otJm? district 
^rsimnel with whom tiiey had to interf^bce in order to teplattsst ^ 
.^j#^t. One exaaqple of this problem ims the asaifDmmt of P»|Wt Aisi^t^^ 
^aidM to non-r^^ and ev» non*»iiMtructiQnal dujtiel at aev«al -project 
sclbola^ Theai ^ties, assigned bv the prajeet i^s^iool tt^dtavi and 
-pUbicipals, were apparently m«de in r^M^ tp^per^tiired.a^tocd nee&. 
However, th6y were countirjto project proiMsai giiidmline^ The maiMige* 
mept.Of the project appareAtly lacked the j^horit^ to ei^orfi^ actHK>l 
conformance with project guidelines, althm^ they themael^vea fiilt they 
were to,, be held accountable for failure^ to me^et thi guidolinea.' 

-Thb last problem is a complex one, involving re3,ations^ips bel^^Ofia 
district personnel who function at dif f ermt le^i^ md in different 
capacities in -the district. On the one hai&d, principals (and teachora) ^ 
derve the district .as part of a line chain of rnisnd ^ Tlinjl itn 
entruated with responsibility for the majoj^ work of the scl^ld: ^ instruc-* 
tion of students. On the other han^, apecial program ataff <ilk<^ 
Project Aasist managiBMmt) serve the schools in a otaff capaci^* Their 
function is to: support^ existing instruetioogl services. BoneD^^ they 
«lso perceive that their role includes enforcing the federal g^4elines 
and proposal plmns ^ich the schools and ^e district administration 
agreed to f<i^llow when accepting federal project monies. They feel ^ , ' 
reaponsible to the funding agency (and are made to feel ao by the fcN^eral 
program officer). Very often, impasaea are reached between project 
management and school. personnel when project guidelines seen to conflict 
with needs perceived by school personnel. ^ 

/, ^ * 

Seemingly, vwhat is needed to remedy problems such as the one cited 
above, which, reportedl y did oc c u r i n Pr o j e ct A a ai at ^ t o som e d e gr ee Jrhis - 
year, is an in-distfict mechanism for conmunicating and enforcing such 
guidelines, and a cmmtitment to do so. At^ least^tlfo^soljitions^o^ tliia~~ 
problem appear pcaaible, One solution would be for project staff to 
cosmimicat^ deviations from guidelines to their superiors, who in turn 
phould follow the appropriate upward ^d downward consmnication channels 
, linking staff and line personnel, ih trying to resolve st^h problems* 
This "recommendation assumes and requires the cooperation of higher 
level staff and line personnel in resolving discrepancies in the goals* and 
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^'^Iflbrities of the ^persdnnel/ below then^. The^Xmifyitlg goal should be 
* to mtjg. tovurd providing improved educational experiences for the 
stu4eiits involved* • ' ' ^ ' . 

The other possible solution is fdr the district to Biiq>ly not write 
federal pi^oposals which dq not meet -caiopus^levelT needs *aqd irfiicii» JLn 
fact* aometimest create on-^campus problems* This solutioti could pefhapa. 
^ be cajrried out by involving: principals ^nd^ teachers mo;re' iji the writing 
of proposals to fund projects ot\ their campuses*. ' . 



The above alternatives are not int«^f d to specify iihat course of 
aetion should be followed, but ar£ offered as thougttts . Aone^P^^i^ ^ 
difficult problem which distfict decision^m^l^cSr^sfust a^ 



C. EVALUATION DESCRimON 



Hittorical Ovgrvlev; Project Asgist EvalUj^tion 1973-75 

The ev^uation done by the Office of Research and Evaluation for 
^ha 4iAt-t«D^ years of Project Aasist vas an extenaive one. Infor- 
ution relevant to outcome, process aid input objectives was col- 
lected and reported. The evaluation staff of Project Assist con- 
sisted of four full-time employees: one project evaluator, two pro- 
cass evaluators^ and one secretary. Funding for evaluating Project 
vas $51,992 in 1973-74 and $42,812 in 1974-75. 



1975-76 Evaluation 

Funding and Personnel ; The evaluation for 1975-76 is much less 
extensive than that done in the two previous years, since funding for 
evaluation was cut cpnsiderably by the USOE negotiators* this year, 
only $10^056 was provided for evaluation of the project* Of this 
aiiount, $3500 was allotted to pay outside consultants to perforn 
management and process audits. An additional $5000 war allocated to 
pay the salary of a half-time intern no collect, analyse, and report 
outcome information; as well as hire, and coordinate the work of the 
outside consultants. The remainder of the funds were designated 
to cover the cost of office s^ppli^s, data analysis, xeroxing, 
and reproduction of the Final and Tectmical reports* 

** 

Evaluation Design ; The Evaluation Design was drafted in September 
'and October 1975, by the Project Assist evaluation Intern, with input 
from other Office of Research and Evaluation staff meo^era as well as 
the Coordinator of Project Assist* The design Included an Evaluation 
Tltteline, a series of outcome objectives on which infonuition was 
to be collected, and a small number of decision questions which seemed 
appropriate to this year's continuation of the program. 

Evaluation Timeline ; The Evaluation Timeline was revised several 
times luring the year, to reflect more realistic estimates of 
the time required to acc^plish evaluation activities. Computer 
processing of data, in particular, was foui^ to require con- 
siderably more time than had been anticipated. A copy of the 
revised Timeline is included as Figure 111-1 in this section of 
the report. ' ^ 

Outcome Objectives ; Each of the components of Project Assist 
had one or more outcome objectives on which Information was 
collected. For Project Read arid Project Hath, there was an 
analysis of achievement data in those subject'' using the . ^ 
Reading and Math subtests of the California Achievement Test 
as the criterion measures. Data were also collected on changes 
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In math attitudes forUhe^th componenty^a well as teacher 
ratings of success of l^Mputreach coiq)onent.y' The evaluation 
ueslgn a^ called for information Xp be gathered on changes In 
ethnic attitudes for Project Assist student^fMttlLclpating In 
^ Trilogy. However, this aspect of the Trilogy component was not 
Implement^, so this Information was not collected. The specific 
objectives and their degree of achievement are reported In 
Chapter IV of this rej^ort. * ^ 

Decision Questions ; Although a small nus^er of decision questions 
were Included In the design. Input and process Information con- 
cenlng program Implementation vital to answering such questions 
was not collected by the Office of Research and Evaluation and 
must be gleaned from the reports submitted by /the outside 
contracted .auditors. The decision questipns^and relevant outcome 
data collected by the Office of Research awl Evaluatloni bIus 
Information on implementation reported by^ the outside cmsultantSt 
are presented in Chapter II of this report. 

Evaluation Instruments : A variet^ of instruments were used to collect 
the outcome evaluation information for Project Assist. A standardized 
test, the California Achievement Test, was used to collect information 
on achievement: in reading and math. Math attitudes were sai^led with 
Fall and Spring administrations of the Math Attitude Test which was 
developed in a^prevfous year by the .Office of Research and Evaluation. 
Short questionnaires using Likert scales and open*eiuled qiiestlons 
were developed by the Project Assist evaluator to collect Information 
for the Trilogy and Project Outreach components. A careful search was 
also conducted for instriments suitable for nMsurlng changes In ethnic 
attitudes,^ in anticipation of Project Assist student involvement in 
Trilogy. Although this component of the prograiii wskS not implementad 
this year, the measurec* found, which were reposd^ded by Dr. Walter 
Stephen at the University of Texas, may be employed if this component 
is iiq>Ieqiented in the future; 1 

Copies of the instruments used, along with a tect^ilcal appraisal of 
their reliability and validity and the conditions SurroMnding their 
administration are available in the 1975-76 , Project Assist Technical 
Report on file at the Office of Research and Eval|aatlon. The 
Technical Report also * contains a detailed analysl^'of th^yesults for 
each instrument. 

Outside Consultants ; As was mentioned earlier, ir^put and process 
Information for ^Project Assist was supplied by outside consultants 
this year. The Office of Research and Evaluation had the responsi- 
bility of contracting with the consultants for their service. A 
decision was made to divide Program Goiq)onents in such a way that one 
consultant would report on the academic components: Project Read and 
Project Math as well as provide a liianagement audit. A second consultant 
was contracted to do thc: process audits on the human relations 
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components: Projfsct Outreach and Trllbgy. Dr. LaVor Lym of the Dallas 
Independent School District evaluation office was hired to do the 
aeadeaic and management aludit. Mrs. Mary Minter^ a graduate student u.n 
educational psychology who has had experiep^e with school and Federal . 
programs 9 was hired to do the human relations audit. 

The consultants* reports were nkade on the basis of site visits » with 
approximately three days per visit devoted to visiting Project Assist 
. schools and interviewing project personnel at different levels. Each 
consultant conducted two site visits: one in January 'and one in April. 
Following their visits 9 ^ach submitted a report to the Office of Research 
and Evaluation 9 on the degree of Implementation of the respective Project 
Assist components. The Office of ^search and Evaluation took 
responsibility for subsequent release of the reports. 

The consultants' reports are included in a separate sectlod of the 
Final Report. j 
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EVALUATION FINDINGS 



OBJECTIVES 



1. ( OPTCfflB ) laproved rMding achieveMtit. By the «iid of thm 
instntctioDAl period (Sept*<Mber 1975-ltay 1976)^ tWt number 
of' students reading on grade levej. in grades 2, 4» 6» 7» 
and 8 in project schools will be as follow*: . 

School 



Oak Spr^^ngs 

Rosewood 

Sims 

Martin 



Allan 



Grade 


X !te«dtag ott Gr«d« Level 


2 




27X . ^ 


4 


* • 


11% 


2 




46X 


' 4 




33% 


6 




m J 


7 




18t 


8 ; 




18X 


6 




17X 


7 




16X 


8 




1^ 

y 



Each of the percentages^ listed above is an increase of ten 
percent over the ntaber of students reading on grade level in 
February 9 1975. The criterion seasura in both 1975 and 1976 

will be the Riding Subtests of ^the Calif ortt.ia Achievement Test. 

• ' _ ' * 

LEVEL OF ATTAINMENT: Not achieved.^ 

Reading scores si^t the criterion of ten percentage points* gain 
in only two of the ten gradea checked » The scores lAich reached 
criteritm were second grade scores at Oak Springs and fourth grade 
scores at Rosewood. Scores in two other grades alao improved » 
but not by ten percentagib points. Scores in 3 gradee were lower ^ 
the last year> and in 3 others scores rained the same. 
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SUPPORTIVE yiA: . * 

Calif o^tiia Achi>ev«aeat Test ; 

Th« reading subteet of the California i^hievcaient Teat; , 
(CAT) vas used to measure^eading acUievew^t of students 

in grades 2 » 4, 6, 7, and^ at all Project Assist schoolat 

As sbgw ill Tabl^ IV-l beloiy» ^'readijag sccftes in four of 
thsr grades at Project Assist schools vtt!e higher than lest 
year;* scores in three grades nere lover; and to three grades 
the scores remained the ease. ' Roienood and Oak Springs^ ^ 
students* scores shomd tl^ greatest gaiji as compared to' 
last year, 'Fourth giwders at Sosewoody iAd> scored 16 
percentage points tiigher" than last year's results^ were the 
only students nbo clearly mmt the critericnr of IJD jptercentage 
points* gisin. Second graders at Oak Sj^ings^were cme 
percentage point of achlieiring It^peintt^ ^r:^^jN» ^helr scores 
vere^ also given credit for reacbiiig eritwiim* ItoM of -the 
other grades end schools checked reached^ the tttft-^int 
criterion. Second grade scores at Sim Wre up fr^ last 
yeart but fourth grade scores itere doim* ^ixtb and eighth 
grade reading scores were doim at Allan mad seventh ^ede 
scores were ifp. Scores i» sUSgrades at Martin renained 
at the same level as last ye«Cr; 

'^ble IV-1: COMPARI^Olf OF STU))E31TS HgADIHGiON GSUX LEVEL IN 
PBOsIECX ASSIST SCHOOLS IN 1973-76, WITH THOSE IN 
1974«75, AND WITH OtlTEEION SCOBES. 
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*> 


d 


6% 


9% 




19% 





The outside* ccmsultatjit hired ta report on implementation of 
Project Kead found that vfaiife instrudtiona]^ aides vere ^ 
generally in the cJLassrdoss to help with r/adiivg as planned, 
the reading curricultm outlined ;in th% Prcflect A8sist»pro-> 
poaal ima not implettedted thia^year, eicci^^ in the Residing 
Labs at Hart in. He therefore cauti<med that the outcome 
evaluation cQuld teat for the effect of instructional aidea^ 
piua apecialcurriculum only for the studentsr ln;^tfaoaa-laba^ 
Therefore, results for those students should be teportedi 
separately.^ . / ^ 

. * 0 

The teacKei: in charge of the Martin liba reported that thia 
year, all isixth and seventh gradera'at Martin paifticipated 
in, the labs. No eighth graders participate^ ^ ^ 

The results for Martin sixth and aeventh grsde Reading 
Lab participants ^re contained in ttie precading tables Aa can 
be seen, the participation in the Reading LUb plua contact- 
with the instructional aides was not sufficient to telp'*^ 
these atudents. acora higher t;han stu^nts in the jiame gradea 
•at Martin last year. , • 
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(OUTCOME) Ii)q>roved Math Achievement. By the end of the 
instructional period (September 1975-May 1976} , the folloving 
perciBntagea of atudents in gradea 6, and" 8 at Martin vill 
M iporking on grade level in m#tb aa meaaured by a lata 
Spring 1976 adminiat ration of the Math Subtesta of the Cali*- 
fomia Achievement Teat (CAT). 



Grade 
6 
7 
8 



% on Grade Level in Math 
12Z 
19% 
25Z 



Each of the percentages liated above ia an increase of ten 
percent over the number of atudents do^ math on gradi level 
in February, 1975, as meaaured by the Math Subtest of the 
C;.lifomia Achievement Test (CAT). 

LEVEL OF ATTAINMENT: Mot achieved. 

SUPPORTIVE. DATA: \ 

California Achievement Test 

The math subtest of the California Achievement Teat vaa used 
to meaaured math achievement for students in Project Assist 
math classes (grades 6, 7, and 8) at Martin Junior High. 

As shown in Table IV*-2 belov, math acorea at Martin ifsre not 
improved this year. The percentage of aixth grade students 
working on grade level remained the aame thia year as laat 
year, while the percentage of aeventh and aighth gridera on 
grade level dropped, o Therefore, none of the grade level 
scores met the criterion set for this year. 



Table IV-2: COMPARISON OF PROJECT ASSIST STUDENTS WORKING ON 
GRADE LEVEL IN MATH AT MARTIN IN 1975^76, WITH 
MARTIN STUDENTS WORKING ON GRADE LEVEL IN MATH IN 
_1974-75, AND WITh'mATH CRITERION SCORES. ' 
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(OyrboiS) laproved studBiit math attitude. The nean score on 
the Hath Attitude Teat for students in grades 6-8 at Hartin 
will be significantly higher on a Spring post-test than the 
Man score for students in grades 6-8 at Hartin on a Fall 
pre^test. 

LEVEL OF ATTAINHENT: Not achieved. 

♦ 

The possible range of scores on the HAT was from 0 to 17 » 
with 0 representing the most negative response possible and 
17 representing the most positive response possibler The 
average pre-test score for this sample nas 10. 8. The average 
post-test score vas.11.0. There is no significant difference 
in these scores; therefore » the objective was not achieved. 

SUPPORTIVE JDATA: \ 

Hath Attitude Test \ 

The Hath Atti^tude Test (HAT) was given to Project Assist 
math studendr at Hartin to ^«^p determine lAether the priaence 
of Project Assist aides and 'riculum helped improve student 
attitudes toward mathematics od their math classes. The 
HAT was given early and late in the yaar in a rough approxi- 
mation of a pre- post- administration scheme* Slightly over 
500 students were in Project Assist math classes end therefore 
were eligible to take the HAT. However, bec4iuse of student 
absences at the time of testing* only 384 students had valid 
score_s for both pre- and post-tests. The results reported 
here reflect only those students' scores. 

Possible scores on the HAT range from 0 to 17 » with 0 
/representing the most negative response possible, and 17 the 
most positive response possible. The average pre-test score 
foi Project Assist students was 10.8; the averege post-test , 
score was 11.0. Not sutprisinglyt the test fot significant 
gain indicated that there is no significant difference in these 
scores. (The probability of such scores occurring by chance 
alone was calculated to be .4821» or approximately 48 times 
in 100, well over the five or fewer times^ln 100 that would_ 
be required for the difference to be considered significant.) 
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(ODTCOME) Aujiience (faculty and parent) awareness of Trilogy 
goals. The aajority of faculty and parents sampled from 
Trilcigy audiences will be able to name correctly at least , 
one major goal of Trilogy, based on viewing a production, by \ 
the group. 



LEVEL OF ATTAINMENT: Achieved. 



Trilogy did ndt perform for Project Assist par«tits« However, 
performances at Martin and Rosewood, were Attended by Project 
Assist faculty and Staff* 6at of 15 questionnaires returned 
following the Martin performance, 11 respondents correctly 
identified one or more ^j or Trilogy goals* Out of 46 
questionnaires returned following the RosewcKxl performance, ^ 
39 cprrectly identified major Trilogy goals, rtom both 
performances, 50 out o& 61 questionnaires, or 83Z, gave t:6rrect y 
responses. ^. 

SUPPORTIVE DATA: 

Trilogy did not perform for audiencies consisting^ prilMtily 
of Project Assist students* parents, as had been planned.. 
However, two performances were Kild at Pro^tct Asiist schools. 
One performance, held at Martin Junior Bi^ In Jaimai7» ir«s 
attended by the faculty and studMta; A aecond perlformance, 
held at Rosewood Elementary ^in May, was attended by faculty 
and staff from the project elementary schdola: Rosewood, 
Oak Springs, and Sims* 

Teacher^ and other school ptrsbimel wtro viewed the Trilogy 
perfoniinces were asked to AMe what th^ thought to the 
major |oals Of Trilogy. Th* purpose of tht queetimi wAs to 
find out how effectively the actual Trilogy performancesT 
succesKled in getting across the key ideas of tha people who 
planned them. A content analysis was performed on the 
respc^ses to this open-ended question. The respondents* 
answers wer^ compared to a suwary of major Trilogy goals 
prepared by the Project Aisist evaluator on the basis of 
interviews with ithi^l^roject Asiist and Trilogy Coord iiiat or s« 

On theiwisiff of tfatr eomparigonr^y'^^^ttfe n was made as to 

which respondents wefd able to correctly identify one or more 
major goals of Trilogy. Out of 15 questionnaires returned 
following the Martin performance;, 11 respondents correctly 
identified one or more major Trilogy goals. ^ Out of 46 
questionnaires returned following the Rosewood performance^ 
39 correctly identified major Trilogy goals. Frott both 
performances, 50 out of 61 questionnaires, or 83JEj^8ave correct 
responses . 
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t«bl« IV-3 gives & detailed analysis of the goals the school 
personnel saw as csnt^ral to ^-rilogy, based on viewing a/ 
perforaane^ by the ttUipe. Correct responses fell Int/ the 
follewlng general catWgoriep. Many respondents felt /that a ! 
■ajor goal of Trilogy is to facilitate understandinj^ and 1 
cosaninication among vjirious school subgroups (such/as teacherf 
parents, and students, or ticsibers of different ettoic groups) j 
by Mlcing thea mor i airare' ot one another's po'lntf of iiw. 
Other people /elt bhej major emphasis of TrilogjT i« to demon- 
strate the universality of human nature C^fe /£ra all people 
with prdblws") by helping Viewers switch perspective so thai 
they see the motivatlms behind the sctioni of others as well 
as hoie their own acHms appear to other a; Some people f el tf 
Trilogy had the more general goal of pinfsenting for scrutiny! 
some of the prob ena Existing in school and society today. I 
Other .people allude(L^o the use of in confronting ' 

pl^oblems or the imwfctance of open c^ionf rontiicion and teamwotk 
in the solution , of^probl'—- ° / ^ i 



Table IV-3: 
1. 



I 



,7SIS OF AUDI^CE LISTINGS OF TRIL06T GQALSI 



Based on/today's performance, what do you believe the ijicmbers 
of Tril^ are trying to accon^lish.? (What are the major goals 

of Trilogy?) • • ; 
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A ainprity of tht school psrsonnsl ^o f illtd out qusstlon- 
oairM on th« two Trilogy performaaces at Project Assist 
schools wars ux^sbl# to cotrsctly and dsarly Idsntlfy Tri- 
logy tosls. Two psopls fsilsd to answsr ths qusstion. Ons 
or two sscMd to havt slsundsrstood th# purposs. (Ons ^rson 
fslt s Msjor goal was ^to gst ths students to sss how thsy 
rsally act in ths classroom, And ssvsrsl psopls gsvs 
answsrs that wars too vagus to dsnonstrsts sn undsrstanding 
of Trilogy goals (s.g* "coawnicste and sntsrtsin^)« 
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^ 5^ (OOKXyC) Audience (faculty and parent) evaluation of Trilogy 
effectiveneas in meeting goals • 

The majority of faculty and paranta aaa^led trpm Trilogy 
audieneaa idLll, when liating Trilogy objectivaa, aay that the 
group ia meeting thoai^ obj^ectivaa effectively. 

LEVEL OF ATTAIMMEMT: Achieved. 

Trilo({y did not perfom for Project Aaaiat parenta. However, 
perforaancea at Hart in and RoaenooiA wt% attended by Project 
Aaaiat faculty and ataff • At the perforwacaa* the pMijority 
of the people who filled out queationnairaa <53X at HartiA 
and 84Z at Roaewood) indicated that thay felt 1^ M^era of 
trilogy vera neeting their goala vary affeetivaly. A additional 
33Z of the Hattin audience felt Trilogy mmkmn wnm seating 
their goala aottevhat effectively. Tbeae r aapo«iaaa ^ka it 
clear that thia objective waa achieved. 

SUPPORTIVE DATA: 

Trilogy did not perform for audiencea conaiating prisarfly 
of Project Aaaiat atudenta* parentf » aa had baen planned. 
However, two performaocaa ware held at Project AMift aehoola.* 
One performance held at Hartin Junior High in Jwuary* waa 
attended 1^ faculty and atudenta. A aecimd p«rformaaca» 
held at Roaewood Elementary in Hay waa attaodad by faculty 
and ataff from the project elementary achoalat loaewood, 
Oak Springe, and Sima. 

The~ teacher a, aidea, and adminiatratora who viewed the Hartin 
and Roaewood performancaa ware aakad how affectively thay felt 
Trilogy membera were meeting their goala. The reapcnelaaa from 
both gr6upa, which are auamar iaad in Table wer e ov er^^ 

whalmlngly poaltlye. ^ 



Table IV**4: RATINGS OF TRILOGY EFFECTIVENESS IN HBETING GOALS 

2. How effectively are they meeting theae goala, in your opinionf 
(Circle) 
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wnf iMTt iKtaUtt to earn 'my tffootlY^isrT 
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. Fif ty-^three percent of the people at Martin felt the goals ^ 
.were being Mt very effectively* 33X fel^ they vete being tMt 
•oMirtiat , effectively » and 14% (two people) registered their 
feelings as neutral. People vho viewed the peirforaance at 
Boseipood were even sore enthusiastic » with 84T saying they 
fflt the group to be aeeting their goals very effectively. 
Seven percent said* they felt the gosAs to ba «et sdaswhat 
siffeetively and another 7X claised to be neutral* A total of 
threa^ople marked "vary ineffectively" in responding to tWLs 
i|ttestion. Frosi other coaoMmts on their questimmairest it 
was obvious that two of these p#ople aeant "very eff ectii^ly»" 
and their respcmses were recorded as such. Hie thitd person,^ s 
questionnaire was wore diffioalt to interpret, so that response 
was recorded as warked, although it is entirely possible that 
it was intended to be recordi^ as "vsry ef feetivsdy." Even 
allowing for this one possible negative respimsa and discounting 
for pe<^le's tendency to snswer soMndMit sore positively on 
such questions than their real l^elings would warrant, it 
can be aaid that people polled def initalj' felt the Trilogy 
troupe was pursuing its go^ls in an effective wannir. 
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6. (OUTOOMB) Increancd inter^ithnic social contact and oore jioaitive 
iatarattmic {attitudes. At least 50Z vf Ttiiogy (participants 
wiU score significantly higher on a Ute Spring 1976 ad- . 
■iaistration of iitetruMnts aeaiuring interethnic, attitudes 
and intarcthqic contact than on adainistration of' the saae 
inatruBttits at the tine of the group's foraation in early 
February. s , ' 



LEm OF ATTAINMEliT: 
this objective. 



Mo data were collected relevant to- 



Plans for beginning a Trilogy troupe coaiposed of Project 
Assist students were not Jjqpleaented this year. Ihenfoce, 
no inforaation wh« collected on attitude change in Project 
Assist Trilogy participants. 



\ 
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(OUTCOME) Imptovement of students referred for social 
services, as judged by teachers I 

At least 1/3 of the students who have been served by Project 
Outreach will have improved in the areas for which they were 
referred, as rated by teachers in a questionnaire administered 
in late Sprinjg. 

LEVEL OF ATTAINMENT: Achieved. 

Approximately half (49%) of the referred students were 
describedt as currently improved compared to their behavior 
at the time of referral. A Hightly smaller but sizeable 
percentage of students served early in the year (41X) were 
described as showing immediate improvement* Approziinately 
two-thirds of the people queried believed the interns hiad 
been helpful, regardless of whether they felt the specific 
student on whom they were reporting had improved^ The 
percentage of respondents who credited the intei^ns with a 
positive impact was even higher among l:he people who had seen 
definite improvement in the referred students. Within this 
subgroup, 85% saw the interns as helping prpmote the positive 
changes observed. 

SUPPORTIVE DATA: 

Project Outreach Questionnaire 

The Project Outreach questionnaire was designed to fintd out 
if faculty members saw students referred to Project Outreach 
as improved, and if they saw the social work interns as con- 
tributing to any improvanent seen. The findings for the major 
questions afe summarized in the tables and text which follow* 



Table IV-5: FACULTY PERCEPTIONS OF STUDENTS* CURRENT PER- 
FORMANCE AT TIME OF REFERRAL. 



1. How would you describe the student's current perfortonce 
in that (referred) area, compared to -his/her performance 
at the time of referral? 



PivfnraiBrft 






SaitHSSd 


Sin 


Total 


Vtnr such won* 


2 


0 


0 


0 


2 ( 2%) 


2.. 9«tvb«t wrt* 


' 2 


1 


u 


0 




I. About tut iMt 


6 


6 


20 


2 






u 


6 


12 


6 








3 


3 


U 


15 (171) 




r 


I 


0 


0 


? 1 ?«) 


.^fiSti4.,, 


20 


17 


?? 


u 


«9 



4^ 

43 



\ 



The infoLmation in\the table above indicates that 9 out of 
88 students » or aboiit 107 of the sample^ were considered to 
be worse at the time the questionnaire* was sent than, at the 
time of referral. Thirty-four students, or about 39Z were 
perceived to be about hhe same. And 43 students, or almost 
half the sample (49Z) w^e considered to be improved* The 
^current status of two students was unknown. 



Table lV-6; FACULTY PERCEPTIONS OF TEMPORARY CkANGES IN STU- 
DENT PERFORAANCeNdURING and immediately AFTER 
TREATMENT. ^ ^ 

2. Some students received help ^rly in the year, ^and it is 
possible that there was a taappraty change in their 
behavior which has since disappWred .If this student 
was helped by the social work inVerns in the Fall* how 
w^uld you describe his/her perf orunce during and imme- 
diately following contact with the\social work interns , 
compared to his/her performance at the time of referral? 
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The results presentjad^aboy^^ indicate that only^ students, 
or 3X or the in tR£^ 

during and iomediately after treatment; Thirty students, or 
4SZ of the sample were seen as remaining the same. Twenty-e 
students, 41% of the total groups were perceived as showing 
dome degree of improvdnent during and immediately after 
treatment. The immediate effects of treatment were unknowh 
for seven students, ,who constituted lOZ of the sample. 
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Table IV-7:' FACULTY PERCEPTIONS OF SOCIAL WOBK INTERNS' 

HELPFULNESS IN WORKING WITH REFERRED STUDENTS. 

3. If you saw a change for the better in this atudept'^ 
behavior, do you believe the vork of the social vork 
interns helped cause the change? 
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A total of 75 people from the four schools T^spondad to 
this question. Forty-nine people, or 65Z of the total saaple 
believed the interns had helped to cause vhatevar positive 
chatiges were noted in the students served* Six people, 
82 of the sample' felt the interns had little poeijtive in-* 
fluence, or in one case, actually interfered with whatever pro* 
gress was made. Twenty people, or 27Z of the sample, stated 
that they did not know whether the interns had contributed 
toward any improvement that was noted. 

A more complete analysis of these <maj or r^ults, as well as 
the interrelationships between responses to the different 
questions is presented in Appendix C of the Technical Report. 
However, the above information dlearly indicates that this 
objc^ctive was met. 
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PgQCMM and Input Obiectivea 

No information was collected by the Office of Research and - 
Evaluation on process and input objectives for Project^ Aislst 
this year* Instead, outside consultants were hired to report 
on the Various aspcfcts of program implementation. The reader 
is referred to section IV~C of this report, in vhich the con-* 
sultants' reports are contained, for this information* 
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B. IirrEBHELATIONSHIPS 



This fection of an evaluation report is J^ntended to tie together 
infonuition on the relationahipsj^ween program inputs, processes, 
and outccMMs. Since , a giv^n program is only one of man)i^ elements 
impinging' pnr schools at any given point in time, the relationships 
between program activities and student outcomes are always' someviiat ^ 
speculative. .Since the information collected on the implementation 
and outcomes of Proje'ct Assist this ye^r was extremely limited, 
with no 6bservations made of actual x:lassroom processes, trying to 
tie together the separate pieces of information on program -£mlemen- 
tatlon and outcomes is even more speculative. Therefore, the^^ 
following ideas are presented as food for thought only. 

Project Read and Project Math ^ " , 

Instructional aides were the key aspects of these conqionents. The . 
major goal in employing them was to enable schools to provide more ^ 
Individualized academic supervision (in reading and math) for students, 
and thereby increase student achievement in these skill areas. The 
data collected by the evaluation consultant indicate that aides thi^ 
year received little training from program staff, and teachers received 
no training. Outcome information showed improved achievement which met 
the criterion set in only two of tea grades on which data were collected. 
Achievement in other grades remained about the asms or dropped. Mo 
observational information is available to vAlfvnVhat the aides did in 
classrooms, and how well they did it. But interview data indicats that 
with somit notable exceptions, aides worked Instructionally, generally' in 
reading (or math) or reading related areas, ^nd that teachers saw them as 
differing, in ability and employed them ac cordingly. The conaultant report 
also indiciated that some teachers spontaneously coiiiiented that their great- 
est criticism of the project was based on a lack of support;, in planning 
and iflq;>lmM^ting instructional experiences. 

One temptimg hypothesis based on the above information is that the 
scarcity of kiAe training and the general lack of help jiven to 
teachers in using the chides to maximum advantage may have contributed 
to the lack of program impact on achievement. This idea is supported 
by findings from more thorough evaluations of Project Assist in 
previous yters. In those^years, it was determined that the program 
was generally implemented as planned, with the exception that, just 
as in 1975--76, little inservice training was given to aides on reading 
instruction and little preschool or inservice training was given to 
teachers on the utilisation of aides. However, the training provided 
was seemingly more systematic and thorough than that offered in 1975-76. 
One specific finding from the 1974-75 evaluation was that trained 
instructional aides contributed to increased individualizatioi. ^nd 
untrained instructional aides to decreased individulkllzation in the . 



^ 43 



"SAt«room,~Tl974-75 Pinal RepoftV'fSXlSrFilot Project Asiist, t>Age"3). 
Hore generally, it was found ^hat instructional aides failed' to improve 
student achievemejBin the program' & two previous years. Teachers 
indicat^dNJ^ougffiM^ responses that they saw a great need 

for furJE^Keo^^aining for aides in classroom management tj^chniques and 
instritfctiou^^ethods, (1974-75 Pinal Report » page 4)« "^Teachers and 
prinqipjuLs also voic^ the opinion that training in utilization of . 
ai4en and materials had only partially met their needs (1974--75 
'PiOK Rejport. page 8), Teachers indicated a desire to see more of thfi 
program staff in the schools (1974-75 Pinal Report, pages 50-55) • , 

Thia evidence suggests that any future programs attempting to use 
^.^4pa^ructional aides to improve student academic achievement should ^ 
[^/mpnasize aide training in" instruction and classroom management and 

teacher training in effective utilization of aides. 



Project Pocus 

A differedt kind of interrelationship that is suggested i>y this year's 
Project Assist has to do with the lack of coherence in the Project 
components and objectives.^ The instructional components (Project Read 
and Project M^h) and the ^uman relations components (Project Outreach 
and Trilogy) wete not logically related to one another ia terms of 
their focus, type of treatment, or goals. Even^thin Projedt Read 
and Project Math, there was a division in project focus and resources, 
with both instructional aides and instructional materials proposed 
as major aspects of these compon^ts. This diversity JiA Project Com- 
ponents made the Project more difficult to administer than it would 
have bee^ otherwise, and may have kept the Project management from 
givli^^ concentrated attention to any one program aspect. This problem, 
in Mm, may have diliited the impact of this year's project. 

;/ 
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C. CONSULTANT REPORTS ON PROGRAM IMPLEMENTATION ' 

Sinc« evaluation funding for Project Assist this year was insuffi- 
ciani to conduct the type of comprehensive input and process evaluation 
custonarily done by ORE^ a decision vas made to contract with putu.lde 
consultants to conduct process and management audits of the project. 

Rationale: The rationale for this decision was two-fold. Oh the one 
hand 9 it was felt that the information which could be gathered 
at the given level of funding would necessarily be incomplete and 
the district's Office of Research an(^ Evaluation would begin to lose 
credibility if it seemingly gave endorsement to such limited methods 
by conducting the evaluation itself. A jecond reason for hiring out- 
siders was that because of the need to sample and to draw inferences' 
based on a small a 'unt of information, interview data is highly 
subject to bias, oi district personnel like Evaluators frbm the 
Office o£ Research aiiu evaluation may have developed biases concerning 
district programi> and issues, it was felt that a fresh perspective would 
b<i aa asset in the preparation of these reports. 

Meth ^^ The Office of Research and Evaluation contracted with two 
comu^ its to audit the implementation and the management of Project 
Assise. The first consultant was responsible for investigating^/ 
implementation of the 'IPro j ect 'ff instructional componentSt Project Read 
and Proj^ect Math, as well as conducting a management audit. The second 
consultant was asked to report on impleaentation of the human relations 
components, Trilogy and Project Outreach. .Dr. C. ^aVor Lym, a Senior 
Evaluator from the Dallas Independent School Distirxct was hired to do 
the instructional and management audits. Mrs. M^ry Minter, a doctoral 
student icT' educational psychology at the Uzdverekty of Texas who has 
had experience working with federal and^-metfool programs was hired to 
do the human relations audits. 

Each consultant made two audits, one in January a^ one in late April/ 
early May. Each audit included approximately three days devoted to 
visiting project schools and interviewing project personnel from dif- 
ferent levels. Sta^s^ records providing information on comppnents were 
^Iso examined. 

The reports enclosed in this section contain the consultants* findings. 
In all, there are four reports, one submitted to the Office of Research 
and Evaluation by each consultant following each audit. 

The consultants* first reports have been released previously to District 
personnel directly involved with Project Assist. 
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Ll»itation» of the Method Used ; The major limitation to the method 
uatd in gathering process data for Prbject Assist this year is that 
the amount of data collected is. necessarily so small. It is entirely 
possible that important information, available at different times fr6m 
those chosen for the audits or from people not interviewed, was missed; 

A second problem has to do with the nature of the information collected. 
Although some program records were examined by the auditor for the human 
relations components, most of the information used came from intervxevs. 
While this method allows for fairly quick and thorough collection of a 
wide variety of information, it is limited by the fact that it is based 
on people's perceptions' of events. More faith could have been placed 
in the information reported if time (and money) had been available for 
systraatix observations of program activities. 



A third limitation Vf the auditing method as employed this year for 
Project Assist, was the lateness of the first audit and hence the 
receipt of the first consultant reports. The Project Coordinator 
voiced the opinion that the information reported would have been more 
useful to her had the first audit been conducted in late October. The 
final audit, which occurred in late April/early Kay was, in her opinion, 
better timed. Perhaps a mote adequate design would have included three 
audits: one in late October, one in late January, and one in late April. 

A final limitation of this method is related to one of the advantages 
mentioned earlier: the fact that the consultants reporting on Project 
Asfeist were outsiders to the Austin Independent School District. 
While they were undoubtedly less biased than district personnel, there 
was also the feeling among some of the people associated with Project 
Assist that the consultants may have lacked an in-depth understanding of 
the context in which Project Assist operated this year. Following 
in-house release of the first liianagement and instructional process^ 
audit report, this belief prompted the Project Assist Coordinator to 
distribute a memo to those reading the report. In the memo, she 
detailed events surrounding the project and made recommendations for 
' the remainder of the year. That memo is enclosed in this section of 
the report, along with a brief memo responding to it addressed to the 
Superintendent from tiie Coordinator of the Office of Research and 
Evaluation. 

The reports and memas follow. 
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Introductioa 

This report prtstats tht findings of a proctts evaluation of tha 
raadlag aathaaatlca coqponanta of Projact Aaaiat, an ESAA Pilot Projact 
fiadad in tha MsoMtisi Xndapandant School District (AISD), Austin, Taxas, 
during 1973«76. Also indudad is inforoation ralatad to a 'Wiaganant 
audit** of tha Projact. Tha findings which ara prasantad raflact tha avalu* 

atora* aasaaasMnu aa liada in tha last vaaic of January » 1976. Tha paramnal 

« 

who conduetad tha procaaa avaluation kni nanaganant audit vara aganta axtamal 
to tha AISD irtiosa sarvicas vara contracted In accordance vith tha proposal 
for tha Project. 

Description of Project Assist > Prior to a three-^ay visit to the AISD 
the only infonnation vhich the evaluators* received concerning Project Assist 
was a copy of the Project proposal aniJ an abstract of the Pro jeer titled 
^rograa Suanary of ESAA Projact Aaaiat.** All other knov^Ledge of thn 
Project vaa gained by the evaliutora during their visit to the AISD. 

Project Assist vas described as an ESAA funded program which vas in 
its third year of operation in the AISD. The eletaantary sd&ools partici** 
pating in the Project during 1975*-76 had not been involved in the Project 
in the past, "dley were Sins, Oak Springe, and Roaewood. Thoae junior high ^ 
schools served by the Project were Hartin, which had bean involved the 
prevloua two^yaars, and Allan, whose past islvQlvettant waa aa a coiqiariaon 
aite for Martin. 

The Project was designed to provide to participating achools tha 
servlcea of 32 instructional aides. Innovative curricula in reading (also 
in nathematlcs at Martin), materials and equipnant to s^port the curricula, 
a schoolH^onBunity social wovk component called Outreach, and an innovative 
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trt«rr«Gi«X Aap9n«nt call«d Trilogy. Aides w«r« to oNst aptclflc qualifl- 
CAtloo r«qulrfta*nts for •mployMnt, w»r« to rtetlv* prM«rvlc« and luatrvlce 
traiaing for th« rtadlng or oathtmatict Qurricult^ to ba aoployad by Projaet 
schools » vsrs to psrtlclpats la Inssrvlcs trslning with tsmchsn, and wtn 
to hsvt dutlts and rsspoQslbllltlss llnltsd to nadl&g lastructlon (or> at 
Martin, sathaaatics instructioa) . Tha raadlng curriculim for tha alavsiitary 
schools was to ba comprisad of tha foUoidAg coi^oiiaiita : laadlag is Fim- 
daM&tal» oral languaga davalopaant, laaguaga aiqNirianca» and prograsMd 
inatnietlon. To ba instltutad in tha junior hi||i achoola vara raading laba 
uclllaing progranad raading instruction, cooqirahanaion cosipcnanca, taachlAg 
aadiinas» oral languaga » and languaga axparianca activitiaa vlth languaga 
and phonics progrsM. Tha nathaaatics lab at Martin vaa to conaiat of tha 
following covponants: raadinass in nathamatics, conputational akllla, 
problaa aolving/logic» aodam mathasatics» and Math in Ufa. Briaf daacrip- 
tions of tha various raading md aathamatica cooponttta appaarad in tha 
propoaal* Claarly conmaicatad was tha notion that tha instruct ionsil aidaa 
and nav aatariala vara to aupport tha raading and aathaaacics cttrricula. 

Foctis of tha Evaluation , Tha focua of tha avaluation vaa ^at forth 
by tha Offica of Raaaarch and Evaluation of tha AISD in vrittan coinm&ication 
to tha avaluators prior to thair viait to tha Oiatricta ^ 
Tha folloving quaations vara addraaaad in tha procaas avaluation: 

1. Ara tha aidaa baing amplorad iaatructionally aa spacifiad in tha 
propoaal? 

2. Ara tha componanta of tha raading and aathamatics curricula vhich 
vara apacifiad in tha propoaal baing ioplaaantadt 

3. Hava aidaa aad t Jiars raceivad, and ara thay continuing to 
racaiva, adaqtiata training and aupport from Projaet ataff to 
allou fiffactiva loplamantatlon of tha Projaet? 
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A. An thm uurials to b« provided with P-^oJftct. Asslt ; tmdM «v«ll- 
Aim and bting utad? 

Follovl&g art thm q^tions which were mddressad In th« ncnmgtnnt 

audit: 

1. Is tba ft4U[fing allocttioa for aaamgamtiit d£ th« Project adaquAtt? 
2« Art tha miiufwnt staff oaSars folloving thair Job daacriptiooa? 

3. Za uaagaaant of tha Projact oparatad in a ayataaatlc faabioQ? 

4. Hov affactivaly vaa tha ordaring of natariala handlad? 

« 

5. Ara Projact aqparviaory staff cogaiaaot of hov tha Projact ia 
oparatlagt 

6. Hov affactivaly ia Projact managaaant intarfacing vith achool 
paraoonal? 

Liaitationa of tha Evaluation > Prior to thair visit to tha Diatrict 
tha avaluators not only vara naiva concaning Projact Assist, but slso had 
UiD prior knovladga ragarding tha organisation and t>pairatioo of tha AZSO# 
This naivaty praaasitad both assats snd lisbilitiaa. On tha ona hand, uha 
^jivaluation could procaad vith cooplata ob J activity. On tha '^^^ hand, 
tha avaluators Vara not avara of tha rolas of daeiaion ukara and hanca 
may hava ovarlookad aliciting Infonnaticm froa eartaln kay individuals. 
Hovavar, vith tha focus providad by tha AISD Offica of Sasaarch and Evalxi- 
ation and tha practical axpariancaa of both avaluatora in achool anviron«- 
Mnta thara appaarad to ba no critical linltations vhich vara introdticad. 

Acting as a aajor linitation, hovavar, vas tha rastrictad tiaa apan 
allottad for collacting nacassary information. Thraa daya vara allovad 
lot rsvlwing projact materials and for Intarvlavlng (a) aldas, taachars, 
and prln.elpala, (b) projact staff, and (c) eartaln cantral adal&latratora. 
Evaluation activltiea were organized to make optimum uae of the available 
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but of atCASslty tha evaluation quMtloas could not be Invattigatad 
to tba dapth which would have baan poa#lbla hm^ mora tiaa baao allowed* 
Hlch tht tlM llaitatloa, no obscrvacioas of InscructleaAl accivlclM 
vtn po«sibl«; in face, chure vu not suffldftnc tia« to cv«n •stabllsh 
th« clla«t« which 1« pt«r«qul«lte to tb-*- ttdmlqu* of data cpllaction. 
Ihua, tha Inforaatloa coacarning the Frojact vaa collactad byoolyona aaana: 
eoaductlag paramal intarvlawa. A aora axtanalvi avaluatlon woul^d hava 
allowad for tha collaccion of coaplamntazy data froa various aoureas (a.g., 
elasarooa obsarvacloos , quastlonnalras, and intarvlawa). As daaerlbad balow, 
^a^ avaluators did pcQCact against credulity and allow for validity checka 
la tha data by having tha different target groups reapond io slnllar Inter- 
rLaw quaatioos. Nevertheless, reliance on one aethod of data collection 

i 

and i:ha raatrlctcd tima factor wart critical llaitationa to tha lavaatigatioa. 

Method 

Target Groups , Inatructional aldaa» daaaroom teachers with whoa aidaa 

worked, the Project aanager* the auperviaor of tha Project ttanager, and the 

AISD head adalniatrator of the developnent dlvialon were, the groupa or 

lAdividuala with whom the evaluators planned to conduct intarvlawa. Fourteen 

of the 32 aidaa and 15 of the teachers with vhos they woiiced were interviewed. 

Following is the distribution by school: 

No. of No. of 

School Teachers Interviewed Aidea Interviewed 

Siw ' k 3 

Oak Springs ' 3 4 

Martin (Math)' 3 2 

Martin (Reading) 2 2 

Allan _3 ^ 

15 U 
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Th« four principal, whoaa gsC^ols ware involved in cha Projact, tha 
Project manager, the .uparvisor of tha Projact manager. «id the adminia- 
crator of the development diviaion also met with the evaluators reacted 
to interview queationa. Not interviewed was the Staff Development Coordinator 
of the Project, who had only very recently become a member of the Project 



staff. 



Instrumentation . Open-^ueation interview schedules spfciflc to each 
target group ware designed by the evaluatora: ParaUel qxiestions appropriate 
for the varioua groupa were included in the different achedules. Thus, for 
•xample. principals and teachers were asked to report about the specific ' 
responsiblUtias and duties performed by the aides; and aldea were asked to 
make a self-report. Collecting similar information from different groups 
allowed cross-validation, a necaasary procedure to an*ure integrity of che 
data. Keceaaar^, but alight modifications were made in the interviw, 
schedule.. as they were applied In the collection of data. Copie. of the 
interview schedules are contained in the Appendix. 

llrocedura. Data ware collected from January 27. 1976, through 
January 29. 1976. During that p.riod each Project achool, eicapt Rosewood, 
was visited twice: once to conduct an interview with the principal and 
again on a aubaequent occasion to hold Interviews with aldM an4 teachers. 
,Mo teachers or aldea were interviewed at Roaewood. The Project mwiager, 
the supervisor of the Project manager aad the head administrator of the 
development division net with the evaluators according to a predetermined 
•chee^ule which afforded mutual convenience. 

Since it was not possible to interview aU the teachers and aides who 
were Involved in the Project, a specific selection technique was adopted. 
Aides were arbitrarily selected, with a deliberate attempt to represent a 



varinty of grmda levels . Among teachers, grade-level or departmental heads. 
wm sought for interviews. With one exception, teachers were interviewed 
only when an instructional aide was able to assume temporary control of 
,th* class or during lunch or planning periods. Similarly, aides were inter- 
viewed only during petiods of noninstruttion or whbn the teacher assumed 

« 

' total control of the class. 

When conducting interviews wit> principals, teachers, and aides, the 
•valuators explained their roles as agents external to the AISD. The 
purpose of the evaluation was briefly described as an effort to determine 
whether or not Project Assist had, at an instructional level, been imple- 
BMmted as planned. Furtheraore, those interviewed were told that a major 
cbj active of the- investigation was to identify aiiy conditions or problems 
which inhibited the Project from functioning optimally, so that appropriate, 
corrective action could then be taken by the Project Assist staff or other 
administrative personnel in the District. 

Results 

Process Evaluation . 

1. Are the aides belag employed instruct ion ally as specified in 
the proposal? 

The 1975-76 proposal for Project Assist stated that in elementary 
schoolO^ exclusively as classroom instructional aides 

on the reading task" and that they would "work with the teachers on one 
grade level." The proposal further stated that "aides at the junior high 
level will work with classroom teachers (in either reading or math)." 



AldM were allocated vlthln each school as follows: 



School 
Sim 

Oak Springs 

Sosavood 
Martin 



No. Aides Allocation Procedure 

7 1 aide assigned to each grade level; 

1 "floater" 

4 1 aide each assigned to grades 1, 2, 

and 3; 1 aide In the reading lab 
.(Hoffman, Title I) 

1 aide each assigned to grades 4 and 5; 
1 "floater" 
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1 aide sezirLng two 6th-grade teachers in 
"self-contained"- situations; 2 aides and 

2 teachers in 6th«'grade reading lab; 2 
aides and 2 teachers. in 7th- end 8th-grade 
reading lab; 2 aides, 1 with each 6th- 
grade math teacher; 2 aides with three 
7th and 8th-grade math teachers 

3 aides with four 6th-grade language 
arts teachers; 1 aide with each of 
threik 7th-grade English teachers; 3 aides 
with six 8th-grade teachers 

Aides typically rej^rted that they assisted students on a, one-to-one 

bfsis or else worked with small groups of children cartying out learning 

activities prescribed by the teacher. Generally, they worked with the 

"slower" learners, those who^i^^the teacher felt could benefit from loore 

individual attention or supplemental instruction. The autonoxsy of the aide 

in assigning instructional tasks varied^ seemingly based on the teacher's 

perception of the aide's ability. In some instances, as for example in the 

sixth-grade ^ab at Martin, aides apparently assumed a very independent role 

in instructing children. All aides looked to the teacher for supervision 

and were generally pleased with the guidance they received. 

5 

Althoupi aides reported that their primary responsibilities were 
instructional, in most instances they also related that they were regularly 
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•xp^ctftd to ptrfom prescribed noalnstructional duties (e.g.^ si^ervise 
•tud«nts In the cafeteria during lunch or during the breakfar^ program^ 
aaalst in the school library, and duplicate and prepare materials for 
instructional use). Corroborative data were provided by blassroom teachers. 
Many extra-instructional duties were assigned directly by the principal. 
Much of the noninstructional support to teachers (preparing n«terial» etc.) 
was accospUshed after the children had been dismissed from school for the 
day. 

In self-contained classrooms TOSt aides and teachers candidly reported 

that Instructij^al assistance was provided in areas other than reading.^ 

That Instructioivwas often described by teachers as "reading related/' such 

as ml^t be the case :(^en sojciai studies materials were covere'd. Aides 

also reported rather frequent involvement in mathematics instruction. The 

general sentiment seemed to be that» although aides were to be en^loyed in 

a prescribed fashion, scheduling constraints and the need for nonlnstruc- 

tional adult supervision made it necessary from a practical point of view 

to have aides askiiat a limited number of other duties. ^^^^ ^ * 

2. Are the' components of the reading and mathematics curricula Vs,^^ 
which were specified in the proposal being implemented ? 

Information obtained from elementary teachers ptfovlded no evidence 
of any systematic efforts to integrate the curriculum conponents specified 
by Project Assist. Teachers viewed the Project as being aimed at supplying 
aides and materials; and, except for the necessary a^ustiumts made to 
accomodate the Infusion of those components, no major, changes had been made 
in the reading curriculum. 

Two reading labs were functioning at Martin Junior High. One, serving 



*»P8tly ••v«nth graders and some eighth graders, was based upon Educational 
DvimlopMnC Laboratory (EDL) materials and equipment. The other, a aixth- 
grada lab, used Hoffman and Behavioral Research Laboratory (BRL) materials 
and aquipnant. Information provided by teachers and aides suggested that 
the EDL lab was functioning more smoothly .than the Hoffman/B!5L lab. During 

' th« visit to the Hof fnan/BRL lab there appeared to be some problems in the 

oi classroom management, and the teachers reported that operation of 
the lab was hindered by equipment breakage. *■ An extended interview with the 
three teadiers in the "mathematics lab" and a visit to the instructional 
Area revealed that a frue lab- approach was not being used. The "lab" and 
an adjoining room accdmodated three classes (two seventh-grade classes and 
oam el^th-gradft class) , and the teachers essentially used the space as 
separate classrooms. The teachers, all of whom were in their first year 
at the school, were aware of the plan to start a IsHb but felt thjey lacked 

V 

the apace, materials, an4 support to establish one* Some materials were 
available, and two aides were providing instructional assistance; but 
otherwise,' the proposed aims of the Project were not being implemented. 

At Allan teachers appeared to be less knowledgable about the curriculum 
eomponenta of the Project. Labs were not operational and teache'*s either 
/Worked with one aide or shared the services of an aide on a predetermined 
achedule. ^ , 

3. Have aides and teachers received^ and are they contlnujLng to 
receive, adequate training and support from Project staff to 
allow effective implementation of the Project? " 

Aides reported that they had participated in prcservlce training con- 
ducted by the Project Coordiuator in either *late September or early October 
Inmtdiately before they began work in the schools. Those who had worked^ in 



Project Assist in th^ past were, as reported by the Project Coordinator, 
placed In the schools ifter a brief orientation. Interview data from 
aides who were replacements for aides who had quit indicated that they 
had been placed with Uttle or no training. Those aides who participated ' 
in the preservlce training expressed the opinion that, although they 
deemed the training worthwhile, it was not specific to the duties they 
were expected to perform. For example, there appeared to be no differ- 
entiation in training according to grade level nor specific reading curricula 
which were used among the schools. "On-the'-job training" by teachers with 
whom the aides worked was reported as providing the greatest benefit in 
those areas. 

No teacher reported having participated in joint training activities 
with aides during the present Project period. Also, apparently little dr 
no inservicc training was held for either teachers or aides. Aides reported 
.turning to teachers for guidance and supervision. Overall, they expressed 
satisfaction with their working relationship with teachers. (Two of the 
aides, however, expressed dissatisfaction relating to inte^Jersonal rela- 
tionships with teachers.) Teachers in general reciprocated this feelina. 
expressing satisfaction with the work performed by aides; however, in cases 
where teachers had direct contact with more than one aide, variance in 
abiUties was frequently emphasized. Teachers also reported that there had 
been no systematic monitoring of their classrooms by Project staff to assess 
whether or not aides were being employed effectively. 

The interview with the Project Coordinator revealed the primary reason 
for the limited amount of staff development; t"he Staff Development Coor- 
dinator had^ot been hired until January. That position had be COM vacant 
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when the present Project Coordinator, who had been Staff Development Coor- 
dinator in 1974*75, bec^ Acting Project Coordinator and finally assumed 
full responsibility as Project Coordinator. 

4. Are the materials to be provided with Project Assist funds avail- 
^ able and being used? 

A copy of the Project budget provided by the Project Coordinator 

revealed that appioximately $92,500 had been allowed for the purchase of 

• \_ 

consumable and nonconsumab>le materials and somewhat less than $6,000 for 
equipment. Materials wete apparently selected by teachers with the assis- 
tance of instructional coordinators shortly after school had started, 
althou^ plans called for earlier selection of materials. Principals, 
teachers, and aides acknowledged that materials had been ordered late and 
many had not yet arrived^^kt^the schools. Principalis in particular expressed 
concern ^hat materials were arriving late. There was also concern regarding 

\the equipment which was to be forwarded from those schools which had pre- 
viously been involved in the Project. The transfer had not been made, 
^ although it would seem reasonable to expect that it should have been made 
shortly^ after the beginning of school. 

^Teachers in general reported satisfaction with those materials which 
ha4 arrived, although oi\e teacher reported that materials were consistently 
arriving in the \»rong quantity. They also reported ttfat the materials were 
being put^ to use instructlonally. Again, however, there was no apparent 
monitoring from the Project staff to ensure that materials were used as 
intended* 

Manag^f^^t Audit . 

1. Is the staffing allocation for the management of the Project adequate? 



The proposed management staffing allocation appeared to be appropriate, 
A program director and a s£aff development person for five school sites and 
32 instructional aides seemed conceptually reasonable. The fact that one 
person was unable to acconqilish the duties of hot i positions from early in 
Septenber through the middle of January clearly demonstrated that one 
indi^dual at the management level is insufficient. With the acquisition of 
the Staff Development Coordinator, it will become feasible to ascertain 
whether the Project^ can be effectively managed^y two individuals. 

2. Are the management staff members folic idjig their job descriptions? 
In an at;tempt to identify the extent to which , le management staff 

members followed their job descriptions, two obstac. were encountered* 
The first involved the resignation of the Prrject Coordinator in early 
Septenber. That vacancy was filled by the Staff Development Coordinator, 
thus, leaving vacant the staff development position until the middle of 
January, although the Project Coordinator attempted to fulfill both roles 
It appeared to the evaluators that the period of time for which the 
vacancy existed was unreasonably long. The "^econd obstad* involved a lack 
of specific job functions. The dual role assumed by the Project Coordinator 
dictated that only those activities needing attention received attention. 
Those activities largely involved preservlce training for aides, acquisl- 
tion ^f materials and supplies, and preparation of the 1976-77 proposal. 

3. Is management of the Project operated in a systematic fashion? 
Managrment of the Project appeared to lack long«-range goals. The 

extenuating circumstances arising from the staff development vacancy kept * 
the Project Coordinator's focus on immeaiate needs: visits to Project 
schools appeared to be based on need or request; interaction with other 
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departatata was dictated by the Immediate need for materials, equipment, 
and so on; and staff development was limited to pr^service training for 
aides as compared to lon^-term and continuous ixiservice training for both 
aides and teachers* 

4. How effectively was the ordering of materials handled ? 

The ordering and ricquisltion^pf materials presented certain diffi- 
culties. There appeared to be limited interaction with the division of 
Instruction in the past operation of the Project. Therefore , even thou^ 
materials had been considered in the spring of 1975, changes were made 
(based on input from Instructional consultants) so the thryst of Project 
Assist would coincide with the District's adopted curriculum. As a result, 
orders for materials were placed late, and the materials were not available 
at i:he Intended time. 

'\ 

5. Are Project supervisory staff cognizant of how the Project is 
operating? • 

The Project Coordinator was aw i ; that many of the components of 

Project Assist had not been Initiated and would likely receive little 

attention during the remainder of the year.^^'^ere also appeared to be m 

awareness of the activities in which the aides were Involved (some df 

which were marginal according to their job description). 

6. How effectively is Project management Interfacing with school 
personnel? 

Building principals thought the Project Coordinator was providing 
adequate contact with them. However, it was apparent that the interaction 
of the Project Coordinator with the principals was largely service oriented 
and did not always ensure the successful fulfillment of Project goals. 
Furthermore, the evaluators could find uo evidence of any systematic attempt 
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to laonltor the Project £t the classroom level (i.e., regular visits to 
classrooms were not made to facilitate implementation of all components 
of the Project) . 

Conclusions 

The Office of Research and Evaluation of the AISD must take into 
account the ftm^ngs of this process evaluation when conducting the end- 
of-year product evaluation* Except for operatio;;i of the reading labs at 
Martin, the educational treatment outlined by Project Assist did not 
exist. Aides had been employed and were working support instruction, 
but they had not received at the Project level the training specified in 
the proposal to uniquely prepare them in either the reading or mathematics 
- program specified by the Project. Since instructional' materials were 

ordered late and many had uot yet arrived at the schools, they could not be 
considered as an intervention for the entire Project period. The reading 
curriculum components had not been implemented at the elementary schools, 
the mathematics lab was not In operation at Martin, and at Allan thei.^ 
were no reading labs. Thus, it would seem that no decision can be made 
for the current Project period regarding the effects of specially trained 
Instructional aides supporting the reading and mathematlrn curricula 
specified In the Project proposal (except, of course, for the reading 
labs at Martin) . The hypothesis of significant program effects (as 
specified in the proposal) can be tested for the Martin reading labs, but 
care should be taken to identify the target populations served by those 
labs. Otherwise, "program effect" must b^ limited by an operational 
definition as greater sui.r.rt of the existing curriculum by ai<J3S and 
materiids . 
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One sicuatioQ discovered by the evaluators nay require some considera- 
tion by AISD adainistrators. Conceptually, developmental projects are 
unique in that they a-?eal for funds on the basis of providing something 
previously unavailable to a speci.fic group of children. Project Assist 
was intended to be unique in that it employed instructional aides who were 
to receive preservice and inservice training specific to the tasks they 
would be given io the classroom. To date this hid not taken place during 
the 1975-76 school year; hence, it was impossible to distinguish between 
instructional aides on the basis of funding source (e.g.. Title I, Project 
Assise). This might create difficulties when one considers justification 
to funding sources. An example that was most obvious occurred at Oak 
Springs, where a Title I lab had been established prior to 1975-76. To 
operate, this lab required the assistance of an instructional aide. 
Instead of placing the Title I aide in this lab, a Project Assist aide 
was functioning there while the Title I aide worked with kindergarten 
children. This obvious mixing of funds and lack of rational for placement 
of instructional aides by program can only create problems. 

The evaluators were quickly made aware of sentiments regarding what 
might occur in the Project schools in the coming year. School personnel 
at all levels (aides, teachers, and principals) had been informed that the 
Project was coming to an end. Significant redirection of the AISD Pilot 
Project under ESAA is being proposed for 1976-77, according to the Project 
Coordinator. In particular, aides weie uncertain as to their futures, and 
teachers were concerned that the present level of instructional assistance 
might be drastically reduced. Inasmuch as the sentiments expre-sed to 
evaluators may also have an effect on work morale, steps should be taken 
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by the Project manager and upper-level administrators to subdue those 
concerns. Certainly aides cannoc be guaranteed a position for next year, 
but steps can be taken to ensure their application (or preference) for 
future positions. Conununicatlon of that endeavor may do much to alleviate 
^mm^^^ present concern. It should be reneobered that in the 1975*76 proposal 
the replicabillty of the Project called for re-employment of the aides in 
the Title I reading program when the Project ended* 

More apparent than concern regarding future* employment of aides was 
the *Vlndlng-dovn'' feeling which was expressed by all personnel who were 
interviewed. The Project Coordinator and Staff Development Coordinator 
may find it advantageous to concentrane on planning, organizing, and 
supporting (throu^ staff development and monitoring of classrooms) the 
reading and mathematics curricula in such a way that teachers can follow 
the tenets of Project Assist in the coming year* A full complement of 
instructional materials should be available for 1976*77 and, if the support 
of the instructional coordinators of the District is elicited, implementation 
of the components could be supervised* In this way the target schools can 
realise the Intended benefits of the Project* 
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Ittftrttctional Aidtt 
BACKCROUMD' 

1« What Is your ^ducatioxul background? 

2. What is your past work experience? 

3. What is the length of your experience as an aide? 

4. When did you begin in the school for this year? 

Have you worked continuously at this school since being placed? 
If not/ describe. 

5. Hov were you selected for your present position (i.e., what were 
the qualifications)? 

WORK RESPONSIBILITIES ' . i ^ 

6. What are your specific responsibilities and duties? 

7. Da you work only in one classroom? If assignnent is split, how 
aany classrooms and how is the tiae allocated? 

(Labs) Do you spend full time in the lab? If not, where? 

8. What percentage of your time is spent in instructional contact 
with students? 

What percent in clerical work (e.g., grading and filing papers, 
preparing materials)? 
Other? Describe^ 

9. During instructional contact, how many students do you work with at 
a time? 

How are the students selected? 

10. Do any of your duties require you to leave the school during nottaal . 
working hours? If so, -describe. 

U. What are your normal working hours? Does this differ from the school 
faculty? 

12. Who supervises your work? ^ 

f 

13. Who do you ask for help when you need assistance? 

14. What lifppens when a teacher with whom you work is absent? When 
another aide is absent? 

15. Do you intend to continue to work as an aide? In your present 
position? Rest of this year? Next year? 

PROJECT ASSIST 

16. When did the Project begin operating in this school? 
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17. It thmvB ftxi Adequate supply of materials? Equipment? If i^t> what 
Is needed? 

18* Do you think Project Assist is effective in teaching reading/natb 
sklUs? 

19. Are you satisfied in your working relationship with the teachers? 
TSAINIIXf ^ ^ 




20. Uhat kind of training have you had in the Project? yhtt?] By whom? 

21. Hov many hours of trainig would you estimate you have received? 

22. Have you participated in any training with teachers? 

23. ^ Do. you think the training has helped you to do a better Job? 
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TtachT 

BACKGROUND 

!• How much experience (no« of years) do you have in teaching? 

2. Hov long have you worked In your present position? 

Have you worked continuously at this school In your present assign* 
ment since the beginning of the year? If not» describe. 

READING* ELEMENTABI 

3. How do you organize your class for reading Instruction (e.g.» grouping)? 

4. How much time do you devote to reading Instruction each day? 
Is this the same for all students? 

5. Vhat materials' and equipment have been provided by Project Assist? 

Stored In the classroom? 
* Kept outside the classroom? Uherr? 

6. When were the materials and equipment made available? 

7. What materials and equipment do you use? Frequency? 

8» . What tr joining have you received for Project Assist? When? By whom? 
Do you feel that the training has Improved your ability to teach 
reading? 

9. What contact have you had with the manager of Project Assist? 
WltH other facllltator(s)? 

10. Have District personnel other than Project staff visited your classroom 
to obtain Information about Project Assist? 

11. Vfaat conditions or problems exist which prevent Project Assist from 

functioning optimally? 
What can be don^ to overcome these weaknesses? 

12. (Reading Components) Are the children In your class exposed to RIF? 
Bow Is the RIF program operated (e.g.» classroom, library)? 

How many books have been awarded? 

Are a sufficient number of books available? 

Have all children received books? 

13. (Reading Components) What Instructional activities are used for 
oral language development? Materials and equipment for support? 

14. (Reading Components) What Instructional activities are used In 
language experience? Materials and equlpmenr for support? 

15. (Reading Components) Is programed Instruction being used? 
What are the curriculum materials/equipment? 
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READIKG/MATH LAB ^ 

16. DMCriptlon of the lab: space allocation, lnaterials^ equipment, 

staffing, location, number of students. 

17. Describe how the lab operates • 

18t How many children are served by the lab? 

19. How long are the children in the lab each day? 

20. How are students selected to participate in ^e lab? 

21. How is placement determined? 

Were placement tests available at the beginning of the year? 

22. When did the lab begin operation (this year)? 

23. Is the lab supplementary to classroom instruction? 

How is instruction in the lab coordinated with instruction in the 
classroom? 

^ 24 « What types of records concerning progress are kept? 

25. How is student mastery assessed? 

26. Hpw are the children handled logistically? / 

27. Were the necessary materials and equipment available at the beginnli 

of the year so the lab could begin operation? 

28. What are the present shortages in material and equipment? 

2?. (Reading) Are all components of the curriculum present? 

Programmed instruction, comprehension, teaching machines, oral 
language, language experience, phonics. 

30. (Math) Are all components of the curriculum present? 

Computation, problem-solving logic, modem math. Math in Life. 

'31« What problems are there in the operation of the lab? Solutions? 

INSTRUCTIONAL AIDES 

32. Does a Project Assist aide work in the classroom/ lab? 

33. How long have you had the services of the aide? 

34. Does the aide have^^work resppnsibilites outside your classroom? 
If so, what? For whom? " ( 

35. How is the time of the aide distributed (2 instructional, Z othe^)? 

36. What special training has the aide received? 

37. Have you participated in any joint training with the aide? When? 
Q By whom? 
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38. In vhat ways do you take advantage of the aide's training? 

39. Do you feel that the training has increased the aide's performance? 



How would you rate the aide in terms of ability? Attitude? Dependability? 

41. Vhat happens if the aide is absent? 
If you are absent? 

A2. Have you or do you work with aides other than the Project Assist aides? 
How does the Project Assist aide compare? 
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1* School description: grade span, enrollment, racial distribution, 

no. of teachers and aides, SEL of conmurijrr Eligible for^Ti^le I, 

free lunch), orther remedial programs 7~^^ — 

^ How long have* you been in your position at this school? , " 

i 

3. How was this school chossn for participation in Project Assist? 

A. Were materials » equipment, and personnel assenibl^ in time to start the 
Project in the fall? 
When did each component become full^ operational? 

5. What are the responsibilities ax^d duties, of the Project Assist "aides? 

Other aides? Assignment to teachers /grade levels? 

6. What haft been don« to inform community* meaibers about the Project? 
Reaction? - ^ ^ le^ 

7. What is the apparent acceptance ol, the Project on the part of teachers? 

Aides? Students? . - ' . , * 

8. Staff turnover (teachers, aides)? 

9. Who is. responsible for the supervision of the aides? 

10. Who provides technical assistance to the aides? 

11. Hpv were .the aides selected? By whom? 

12. What is done when teachers or aides are absent? ^ 

13. What tralning^ have the aides received? 

Haf^it appreciably Improved^ their Job performance? 

lA. Bow would you rate the aides in terms of ability? Attitude? DependatiiUty 

13. What is the frequency of contact with the ProJ^t manager? Project 
.facllitatcfr(s)? 

16. Do you feel that you are adequately Informed regarding the operation 

of the ProJect?^ If not what information is needed? From whom? . 

17. Is the 'Project managed to avoid major crisis? ^ 

18. Are you satisfied with your working relationship with the manager of, 

the Project? Fadlf tator(s)? If not, in what ways? 

19. What are the strengths of the Project? 

What are its weaknesses? How qan they be overcome? 
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20. Do you fetl the Project is effe^ive In improving reading/oath skills 
beyond what might be expected under "tnT^ditlonal" Instruction? If 

^ . not, why does the Project fall short? 

21. What conditions presently exist or have existed which prevent the 
Project from functioning optimally? How can these be overcome? 
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ProUct tUiuger/Facllltator(8 ) 

1. What i^your role it. the Project? 

2. How long have you served in your present position? 

3. Describe organization of Project staff? Job responsibilities? 

4. Work-related background? \. 

5. How were the particular schools in the project selected? 

6. What V«re your scspoxuilblllties In the startrup of the Project? 

7. When were the nateriifls for etert-up ordered? Received? Dletrlbuted? 

8. What shortages presently exist in the supply of materials or equipment? 
What is the'impagt on the operation of the Project? 

9. Briefly describe the. llnplementatlon of the^JroJect to date? 

10. What staff development has occurred to date? What is projected? 

.11. What procedures or system do you use to monitor the function of the Pr^ect 

12. How often are site visits made? Who is contacted on a site visit? 

Are visits made to classrooms to observe instruction? How often? How 

long are the visits? 

13.. What is your role in the supervision of aides? If directly responsible* 
how is this carried out? If not, how are checks, made on the function 
of aides? 



14. What are the Job responsibilities of the aides? Wl^at specific duties 
are the; expected to perform? { 

15 • How were the curriculum materials selected/developed? By whom? 

16* Who ensures that the materials and equipment are being properly used? 
How? 

17. Are }hafU satisfied with the working relationship which you have with 

^ buixding administrators? Teachers? Aides? If not» what problems ^ 

e30st and how can they be overcome? 

18. What is the level of acceptance of the project by building administrators? 

' Teachers? Aides? 

19. What role did you play in assembling the proposal for the Project? ^ 

20. What role do you play in selecting Project staff? 

21. What has been the turnover in staff, particularly as related to instructlo 

aides? 
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22. Ha8 ituffing been adequate tr allow inrpiementation of the Project as 

planned? 

23. How were the instructional aides selected? What were their qualification* j 
Do the xiualifications differ from other aides? 

What is the pay schedule for the aider? How does this compare to other 

/ aides iti the District? ! 

1 . '-^-^ . i 

'( > 24. Are there plans for the Project to continue next year? Will your roXe 

\ remain the same? 

25. Have you received adequate support for operating the Project from 

ether district departments (personnel, purchasing, payroll)? 

26. What has been done to inform community members about the Projact? What 

is planned? 

27. Is the budget adequate for operation of the Project? Will all funds 

be encumbered? 

28; What contact have you had with USOE officials? 

What assistance has tISOE provided? ^ 

1 

29. What conditions exist which prevent the Project from functioaing 
optimally? Solutions? 

4 
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central Adttlnlstrators 

«^ 

1. What information do yoiu receive on the operation of the Project 

(e.g.» reports, meetings)? ^ 

2. How were the particular schools in the Project selected? 

3. Ware you involved in the development or the proposal? If so, how? 

4. Has the Project received adequate support from other District offices 

(pirsounel, purchasing, payroll)? If not, what are the problems? 

5. Has adequate assistance been pruvlded by USOE officers? How is the 

information obtained? Timel>? Useful? 

*v 

6. What problems existed in the start-up of the Project? 

7. Dp any problems presently exist in the operation of the Project? 

How can they be overcome? 

.8. I3 the Project fully operational? If not, why? 

/ 

9* What is the level of acceptance of the Project by princiiials? Teachers? 
Aides? Community? 

10. Is the Project supported by adequate staff development? 

11. Are there plans for the Project to continue next year? Will your role 

remain the ssme? 
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Inuroduction 

Presented in this report are end-of-year findings of a process 
evaluation and manageoent audit o.: Project Assist, an ESAA pilot project 
funded during 1975-76 in the Austin Independent School District (AISD) , 
Austin, Texas. The report is madiJ pursuant to a contractual agroeroent 
between the evaluator and the AIS)) and is a tollov-up to an 'aillii 
report ^ submitted to the District's Office of Research and £vaJj;»rion 
regarding a similar assessment matie during the last week of January, 1976. 

Findings of the January Evaliiation , Generally speaking, the aim of 
the January evaluation was to dete^rmine whether or not Project Assist 
had been Implemented and was operating according to the plan stipulated 
in the proposal. Where a difference was found to exist between the pro* 
ject as designed and the project as it actually operated, information was 
sought which would account for tht» di'^crepancy . Focus of the evaluation 
was limited to four areas: (a) to determine whether or not the aides were 
functioning in an instructional c.ipacity, (b) to determine the extent to 
which the reading and mathematics curricula were being implemented, (c) to 
assess the extent to which the Project was being supported by staff develop- 
ment for aide*? and teachers, and {d) to determine the disposition of the 
instructional materials which weru to be provided with Project fu'^ds- l>o 
management audit was principally addressed to the following: (a) to deter- 
mine if the staffing allocation for management of the Project was adequate, 
(b) to determine whether or not m<inagement of the Project was carried out 
in a systematic fashion, and (c) uo assess the function of Project managers 
in monitoring the operation of th.j Project at the instructional level 
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(I.e., the means used to facilitate infusion of the curriculum components 
and support materials and to ensure that aides functioned according to 
their Job descriptions) • A -najox limitation of both the evaluation and 
the auu^c was the restricted time span during which information was 
collected. Three days (January 27-29, 1976) were allowed for revising 
Project materials and for interviewing a sample of aides, a sample of 
teachers, principals, the Project Coordinator, and certain central adminis- 
trators. The number of teachers and aides who were interviewed were 15 and 
14 respectively. 

Tlie principal findings of the evaluation were as follows: 

1. Aides reported that their primary responsibilities were instruc- 
tional, but in mnny Instances they also related that they were 
expected to perform prescribed noninstructional duties (e.g., 
supervise students in the lunchroom, serve as monitors in the 
schocl library, and duplicate and prepare materic^ls for instruc- 
tional use at times when they could have been in the classroom). 
Althoupji the niajority of instructional support by aides in 
Self-contained classroons appeared to be in the area of reading, 
teachers and aides frequently reported that assistance was 
provided in other subject areas. At Allan Junior High, aides 
worked with language arts or English teachers; at Martin Junior 
Higli, all aides except one vorked in a reading lab setting or 
with specialized mathematics teachers. The aide who was an 
exception' worked full time in a self-contained 8ixt*:-grade 
classroom where two teachers were teaming. ' 

2. There was no evi^'^nce in the elementary schools of any systematic 
effort to implement the curriculum components specified in the 
Project proposal. Teachers viewed the Project as being aimed 

at supplying aides and materials; and, except for the necessary 
adjustments made to accommodate infusion of those components, 
no major changes had been made in .the reading curriculum. Two 
reading labs operated at Martin Junior iiigh, one serving sixth 
graderii and the other serving mostly seventh graders and some 
eighth graders. The mathematics lab(s) had not been organized. 
Also, no reading lab was onerational at Allan Junior High. 

3. The Staff Development Coordinator position had been vacant 
until shortly before the evaluation was made. Most aides had 
participated in a preservice training session which was con- 
ducted by the Project Coordinator, No preservice training 
was held for teachers » and no inaervice training sessions had 
been held for eit'^.er aides or teachers. 
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4. Materials were selected shortly after school had started, 
although plans called for that task to be completed lauch 
earlier. Principals, teachers, and aides acknowledg^ed that 
materials had been ordered late and many had not ye^ arrived 
at the schools. 

General conclusions from the assessment of the management of the ProJe:*s 
were as folTows: 

No Judgement could be made concerning the /adequacy of the ^ 
staffing allocation for management of the Project since the 
staff development position had been vacant for an extended 
period. The personnel allocation seemed conceptually reason- 
able, and the fact that the Project Coordinator was unable to 
effectively accomplish the duties of both program director 
and staff development specialist clearly demonstrated that one 
individiial at the management level was insufficient. 

ManaRcment of the Project appeared to lack long-ran^e >»oals.. 
The Project Coordinator was aware that many of the compcijcnts 
of the Project had not been Initiated, and she ^*xpre\sed the 
belief tliat they would likely receive little attentiua during 
the remainder of the year. Late start-up and the vacancy in 
the position of Staff Development Coordinator were cited as 
causal factors . 

There was no evidence of any systematic attempt to monitor . 
the* operation of the Project at the classroom level (i.e,, 
regular visits did not appear to be made to classrooms to 
facilitate implementation of the curriculum components, to 
ensure the proper use of instruct i^al materials, or make 
certain that aides functioned within thes.r job descriptions) • 

Tlie May, 1976, Evaluation . The end-of-year evaluation was conducted 

to dewermine what changes had occurred in the management and operation of 

the Project since mid-year. Specif ic^ly, the process evaluation was 

addressed to the following questions: 

1. Had thert been any changes since mid-year in the work responsi- 
bilities pf the aides (i.e,, did they function any differently 
than they had at mid-year)? 

2. What progress had been made since mid-year in the infusion of 
the reading and mathematics programs which had been specified 
to be implemented in the Project proposal? 

3. Had there been provision since mid-year for training of aides 
and teachers to facilitate implempntatlon of the iastructional 
components of the Project? 
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4. What had been the disposition of the materials which were to 
be made available through Project funds? 

The following questions were examined in thn management audit: 

1. Had the stiiffing allocation for management of Che Project 
been adequate? 

2. Had the duties performed by management staff members been 
consistent with those duties which th'ey would reasonably 
be expected to perform in their job roles? 

3. Had management of the Project been operated in a sys^tematic 
fashion? 

4. How effectively had the management staff members monitored ^ 
Che operation of the .Project at the classrooib level in order 

to ensure its successful implementation? 

The May evaluation^, suffered ;he same limitations as did the evali;- 
ation which had been conducted in January* Host significant was the 
restriated time span allowed for the collection of information. Duri.ng a 
period of two-and-a-half days, viBl^ts were made to each of the Project 
schools for the purpose, of conducting interviews with aides, teacher,^, and 
principals. Extended Interviews rfere also held with the Project Coordinator 
and the Staff Development Coordinator* All data wer^e obtained from the 
personal interviews; no time was allowed for the observation of instructional 
activities or the colledtion of data by any other means. . 

Method 

Target Groups and Individual s. instructional aides, teachers with whom 
the aides worked, school principals, the Project Coordinator, and the Staff 
Development Coordinator were the groups or individuals from whom the 
evaluator planned co* obtain data. Each principal, the Project Coordinator, 
and the Staff Development Coordinator were int4MFrtes^ed. Nonprobability 
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saaples of teachers and aides were Intervleved; follotfing Is the dlstrlbu- 
tlon by school: 

School No, Teachers No, Aides 

51ns 6 3 ^ 

Oak Springe ' 3 3 

Rosewood 2 2 

Martin ^ 5 4. 

Allan _3 

Total " 19 16 
Instrumentation , The Interview schedul*^s whldi had been used In 
January were revised for use In May* They were reduced In length and chelr 
formats were changed to afford easier recording of responses. Copies of* 
the revised forms appear In the Appendix* 

Procedures , Data were collected from May 5, 1976, through May 7, 1976. 
During that period each Project school was visited and Interviews were 
conducted with the principal and nonprobablllty samples of teachers and 
aides. After all schools had been visited, the Proiect Coordinator and the 
Staff Development Coordinator were interviewed, A conference was held with 
a representative of the Office of Research" and Evaluation upon exit. 

The procedure for selection of aides and tei^chers was similar to that 
used in the January evaluation. Aides were arbitrarily selected, with' a 
deliberate attempt to represent a variety of grade levels and teaching 
environments (e.g«, self-contained, lab, team-tenching, and 'subject -^area 
specialization). Grade-^level or departmental heads and those in unique 
teaching environments were purposely selected for interviews among the 
population of teachers. Of Che 19 teachers, who were Interviewed, 8 had 
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been Interviewed during the evaluation in January; 10 of the 16 aides had 
previously been interviewed. ^ 

Results 

Process Evaluation 

^ • Had there been. a n y chang>;s since mid-yea r In the work responsi - 
b llitles of the aides (I.e., did they function any diTferently 
than the^ had at mid-year)? 

No changes were reported in ;he allocation of aides among the schools 
or the asslgnmfent of aides within the various schools. Aides who had pro- 
vided in January a self-report of their duties stated that there had' been 
little or no change in their -ork -related activities. The most frequently 
reported way in which aides supported Inst ructioi^ was the supervision of 
small homogeneous groups. Acting as a facilitator during periods of 
independent study and providing instruction on a one-to-one basis were the 
next most frequently reported modus of instruction in wliich aides were 
involved. 

Sims. Aides were assigned the task of monitoring the breakfast pro- 
gram from 7:30 a.m. until 8:00 a.n. From 8:00 a.m. until 2?30 p.m., the 
period during which cliildren were in the classrooms, the aides W3re 
expected to maintain a schedule where they worked for various periods of 
time in different classrooms. Each aide* worked onl^' in classrooms- on one 
' grade level. The one aide who worked with kindergarten teachers spent an 
entire day with each teacher, /worl.ing with different teachers on different 
days of the week. All other aides; wc-e scheduled 16 rotate among various 
teachers each day. Two of six teachers who were interviewed noted that 
aides were typically 13 to 20 minutes late in reporting to the first class 
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because of work In the cafeteria for the breakfast program. After 2:30 
aideb assisted teachers in planning activities, grading and reporting, or 
preparation of Instructional materials. 

Tliel:hree aides who were interviewed reported limited involvement in 
subject areas other than reading (e.g., mathematics, social studies, and 
art). Some teachers also candidly reported that aide* became involved in 
instruction in subject areas other than reading. The extent of that 
involvement, however, appeared not to 'be great. Three ot the six teachers 
expressed dissatisfaction in the working relationship with their aides, 
, citing, lack of dependability or lack of enthusiasm as the cause. On the 
other hand, the three aides who were interviewed all expressed satisfaction 
in their working relationship with teachers. 

Oak Springs/Rosewood . Four aides were employed at Oak Springs (grades 
IC-3) and three aides at Rosewood (grades 4-5)* From 7itl30 a.m. until 8:00 a. 
the aides at Oak Springs served as monitors In the cafeteria for the break- 
fast program. Instructional- support, was provided to teachers from 8:00 a.m, 
to 2:30 p.m., during which time the, aides were scheduled to be in classrooms 
With orte Exception, either the daily schedule (i.e., rotation among teachers 
eac^day) or a weekly schedule (i.e., an entire day with each teacher, 
rotating across .days of the week) .^as followed. One of the Project Assist 
aidjs at Oak* Springs worked in the Title I reading lab (and had been placed 
there the entire year), while the athers worke"^ in Grades 1, 2, and 3 
respectively. A Title 1 aide provided instructional support to the 
kindergarten teachers. Aides at Rosewood followed a daily schedule and 
worked in both fourth-grade and fifth-grade classrooms. 
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Only cne of the five aides interviewed at the two schools reported any 
significant involvenient in a subject area other than reading, and even then 
the extent of that involvement Wc^ said to be limited. Two of the five 
teachers reported that aides supported instruction in areas other than 
reading; instructional support fcr "reading related** activities in other 
subject areas was also mentioned. All teachers who were interviewed stated 
ll;at they were satisfied in the uocking relationships with aides, »and all 
lidcs reciprocated with a simllai expression of satisiart ion. 

M artin Junior High , The nine aides at Mart in. Junior High yere 
allocated as follows: two aides served three mathematics, teachers (grades 7 
and 5); two aides worked in a si>th--grade reading lao,; two aides wor'ked in 
a reading lab for seventh and eighth graders (mostly seventh graders); one 
aide served each of two sixth-grade mathematics teachers; and one aide 
worked in a yelf-contained sixth-grade classroom where two teachers were 
icamliir,. 

Aides worked from 8:00 .a^m. until A:OU p.m., the same working h »urs 
as teachers. Classes started at 8:30 and ended at 3:30. From S*A\ until 
8: JO and 3:30 until 4:00 aides were to work with teachers in planning ar>u 
preparation. Ixi most instances, aides also assisted in 'planning anc prepa- 
ritipn during the teachers' conference periods. Except for the ..^y - 
t .aituui s Ixlh-gr.idt classroom, all aides were woj|^ln>; ^\\'v<X\j \\\ lo^^-ding 
i»r mathem*jtics anJ (uiulioiu'd In an instructional capacity. /V>-mivv.i be 
expected, the aide in the self-cent ained classroom was reported ta du 
involved in all subject areas. 

One of the five teachers who was interviewed expressed dissatisfaction 
with his/her working relationship with an aide. The other four teachers sail 

84 



they were either "satisfitd" or "very satisfied" in their working relation- 
shipH with tha aides. ^Among the aides, one of the four w!io were interviewed 
cxprusBcd extreme di««satis faction with his/her. work-related association with 
a tuadicT, • , ^ . . 

Allan Junior Hi ^h. Three* ajdes at Allan Junior High served five 
seventh- and eighth-grade Eagiish teachers; one aide worked full-time with 
one af the teachers, and eich of the other two aides spent one-halt day 
Willi t a. L h of two teachers. Also, three aides s\ip| or ted fli^* c seventh- and 

i^:iitli -grade ' reading teachcis, ore aide working tuil-tin..^ uich each teacher. 
And fiiiallyi three ithei aides wc»rked with 6ix slxth-graJe ted^liors, each 
aide working with two teachers. These "teachers principally taught language 
arts, but they also taught in o.ther subject are£LS (i.e,,, matnematics, 
science,. and social studies). It. fact, aides were scheduled to be present 
during periods when subjects othttr than tending or language art's wcra being 
Lauglit. However, nc^nc of the foiT aides who were Interviewed reported ^work 
in any subject area other thfcm reading or language arts. 

All of the aides who were interviewed stated that they had been 
assigned by the principal to be lunchroom monitors, and One aide reported ^ 
having been assigned a, monitoi in the library. Two of the four aidas 
mentioned that they wtre sometimes called upon to supervise cla.»; ies of 
another teacher for at least part of the day if the teaciier wur^ uriL: ^.pertedly 
abseui; one of the aides noted that the frequency of substitution iiad 
increased as the end of school n€arecl and th^t there appeared to be little 
urgency in obtaining the services of a qualified substitute teacher because 
of the ready reserve of aides, 
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Tlie reports made by teachers and aides generally seemed to Indicate 

that, excluding the time for. duty in the lunchroom, aides were lesj^ fre- 

.quently involved in instruction than were aides in the other school?, Fojr 

example, one ai^je reporTed spending three periods of instruction with 

tcaciiers on Monday^ Wednesday, and Friday and six periods on Tuesday and 

Thursday. "Very little" instructional contact with studet.ts during the 

recent past was also reported hy the same aide. i\nothor aide reported that 

each Frid.ay was typically devoted to "clerical" work. : ill another reported 

that, because of the lunch schedule-,^ one-half of a subsec,uent period w^& lost 

in addition to the time spent monitoring ^he lunchroom. 

^rhe thref' teachers who were Interviewed stated that Lhcv were satisfied ' 

iu their working relationships with aides. One o^^hrm, huwever, nott d 

tliat "mi)r.»U»" among the aides was "very bad" because of tlie assign^Mits <lb' 

lunchroom monitors and service as ad hoc substitutes. Two of the four aides 

expressed extreme dissatis faction with the assignments, noting that those 

work duties were outside their job descriptions and that although the Pcojeit 

qtanagers had been made aware of tae. problem, no resolv ^ion had been reached. 

All four of the aides stated that they we re^ satisfied in their working 

relationships w !i teachers, ' 

2. WiMt , proK^c'^ s- h»ul h*^H*n m i do s In ce mid-^yoa r in t lie Infusion of 
til e bending and math ematics programs which iiad been specified 
to be 4ttplemc!nted in the Pr o j ect proposal? v, 

• 

^None of the information obtained from either classroom teachers or the 
management staff provided any evidence of an effort to integrate the curri- 
culum components 'othSr than RIF oi Math in Life specified for Project Read 
and Project 'Math, ^ Plans for HIF and Math in Life were complete; and, a 
although late, follow-through shortly before the close "of school appeared 
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Iminent. OUierwise, the status had not changed since January for imple- 
mentation of the reading and mathematics curricula (recall that two reading 
labs wore functional at Martin Junior High and had operated since t,tie 
beginning of school) . 

The Project Coordinator expressed the feeling that the proposed imple- 
mentation of all curriculum components in a singl^ year was unrealistic. 
In her opinion the constraints imposed by the late release of funds » tht 
late date at which she assumed control of the Project, and the vacancy In 
the position of Staff Development Coordinator which existed until January 
further at ti'd to im|HHic full ImpiunjcMitat ion of the rro ject. 

3, H.id there bKicn pr ovi sion s ince mid-ye<ir for training of aides 

an d teachers to facilitate implementation of the instructional ' 
components of the Project ? 

The St^ff Development Coordinator indicated that four staff development 

workshops for Aides had been held since January. All of the 16 aides Vho 

were interviewed stated that they had received training in at least two of 

the workshops. Each was asked if the training had sjbsequent 1> Dten helpful 

to on-the-job performance; 11 responded affirmatively, four reported that 

the*training had not been helpful, and one did not give a definitivt ansv^r. 

Following are summaries of the comments given by those aides who felt the 

training was of littie or no value anrfwho offered further explanations: 

1. The information, sklJls, and techniques which werfe imparted 
by the training sessions had already been acquired vnrough 
previous on-the-job ejxperience as an aide. 

2. Course-work in a teacher education program had LOv**red the 
same areas which were focused upon in the workshops. 

3. Emphasis was placed on skills and techniques which had 
greater application at the elementary level (comment given 
by an aide in one of the junior high scho^^ls)* 
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Arcordlug to the Staff .Dove lopmout Coordinator teaciicrs were nut tKe 

* - , 

Kitj'yt^ |H)|)ulat Ion fur any trainin,; ^esslini, nor wcfc Llicri' any sessions 

designed specifically for both aides and teachers. Two of the 19 teachers 

who- were interviewed stated, that ;hey had attended one nf the training. 

sessions for aides, which was consistent wifh the ;.ot ^iivcn by the Staff 

Development Coordinator that teachei^ were invited 1,0 attend lad^a few had 

elected to be present. ' • ' ' • 

^ • m^ilL J*.'Vl ht'i^n tjvj? di sp4>s it ion of the m::t-erials whjg^ were to 
/ . be made avriilable throu^i Project funds? 

Teachers reported that only a few items which had been ordered wlth^ 

Project funds had not arrived, and nearly all of thosexwere thlogs which 

'had been |)ack-ordered. Most of the teachers agreed that th^yast bulk' of 

materials had been received by th'^ end of January, although much of 'tbc 

material was reported to have arr.lved In^the period between Thanksgiving . 

and Christmas, In general, teachers expressed pleasure in the vat'iety and 

^ •» 
quantity of materials which had btien afforded by the Project. Two teachers, 

^ " - . \ 

however, spontaneously stated tha^i^ lack of follow-through in training' 

teachers how to apply the materials was a serious shortcoming of the Projeci:. 

\ * 
Anotlier teacher pointed out that use \)f some of the materials (e«g.« * 

cassette recordings) had been limited because of lack of certaxn equipment. 

For the most part, however, an abundance of materials was evident In the 

classrooms yhich were visited; and nearly all teachers expressed positive 

sentiments about the materials viih.lch had been provided. 

Management Aug it ' * 

1. Had the staffing allocat Ion for management of the Project 
been adequate? 

\ 
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It vsis impossible in Januiary, 1976, to dateruine whether or not the 
Staffing ^Hoc^tion for management of the project was adequate since a 
complete^ staff (the Project CoordlJiatot and the Staff Development Coordi- 
nator) had furtctioaed for only "a bhort while. Even in .May, 1976, a 
datinicive answer 'could not be gi\en to this question. The ntenagers almost 
certainly functioned much diffecearjy than they would have if a complete 
sraff had been present during the first half of the year. 

* One nitical function of mani»geroent, that of carefully .monit< ring 
* implement at ion ^nd operation of the instructional programs, was certainly^ 
hindered because of tlie vacant position. However^ Mu' v 'li. u i liui i-y 

questioned if that funcfion coul4 have been effectively pe:r/.':ed.c en if 
ihe^vacancy *iad not existed* Perhaps a management conf iguracjon where .one 
individual functione^'d full-timu as a progiam facilitator witnouc responsi- 
bility for staff development woulc. have been more adequate . 

2. Ilacf the dutlt« ju-rformi d by mnnnKenwuit_sU|f t '^<'na>y rj^ Jjgjin 
FonS'i^ t c7iT^*i^^ i'F^*^^! f^i^l'klf^J?'^^ ich th ey woti ld_rc .^son> tbl y 
be| expcH zted to pertorm" icriTa»-iT^liob roles ? 

Following are the principal activities which the Project Coordiaator 
and Staff Development Coordinator reported ^as having been accomplished 
since January! 1976: arranging for transfer to Project schools of equip- 
ment from schools participating it* the Project prior to 1975-7b; f^aal 
preparation of the Project prcrpos/il for 1976-77; preparation for Jiv RtF 
program; ordering of additional, materials (classroom libraries); distribu- 
tlon of some Project raateriaU; planning for the Math in Life program; 
planning of the "open house*' for the Project; working in cooperation with 
the Personnel Department to arrange 4or placement of aides; coordinating 
Ttilogy and Outreach programs; arranging and. conducting staff development 



workshops; and >^la;Lclog schools to observe on-the-job performance 'of aides 
md to ^'acc totixe needs of teachers and principals. Ins,crvice training, 
distribution of materials, obser\ation of aides^ aQd holding conferences 
With teachers were reported to b€ th^ primary responsibilities of the Staff 
OevelopmeAt. Coordinator; other activities were the pr^imary responsibility of 
the Project Coordinator* ^ ' ^ 

Information^ obtained ^uring interviews supported the self-report of 
activities made by the management staff. For example, principals 'reported^ 
that the transfer of equlpmen^4iad been made, teachers indicated. that 
preparations were* being malie'for distributing RIF books, and aides noted\ 
the^ arrangements which had been nade for theit continued employment • The 
aforementioned activities were Judged to be cSisistent with those duties 
which the management staff could reasonably be expected to perform In their 
Job roles. ^ ' 

3 . Hac^ mnnagement of/ the Project" been operated in a systigaoatic 

There was evidence that certain activities which were consls^teht with 
the proposal had been planned and were a^out to be undertaken by Project . 
^management (e.g.. Math in Llfe,«BIF, assistance to aides regarding future- 
employment, and the "open house" to fsicilitate replication). Furthermore, 
the Project Coordinator Indicated tha*' the proposed pilot* pyoject undfcfr ESAA 
for 1976-77 was designed to overcome some of, the weaknesses which had been 
encountered during 1975-76 (e.g., seeking to integrate the Project with the 
overall Inatructlonal program of the District, formulating plans to gain 
the complete support of Project schools, and specification of realistic 
goals). This information led the evaluator to conclude that the management 
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of the Project had operated much nore systematically than it had in Janua^ 

" . ■ ■ r . 

Certainly^ having no vacancies in the Project staff contributed slgnific^atitly 

to this end. . \ 

4. How effe cti vely had the management staff mepfcers reonltor<rd ' , 
th e o perat ion of the Project at the classroom level in orde r - 
to urisurp its successful implemen t at ion? . . . ' 

. ' • ^ ' 

Seven of the 19, teachers who were interviewed .reported that neither Che 

♦ 

Project Coordinator nor the Sjtaf f Development Cooroinator had visited their 

olassroome ^ince January. An additional five teachers reported that visits 

had been made to their classrooms py the Staff Development Coordinator for 

tlie purpose of con/crring witii their aide(s) or th ^ tcuchor^ themselves. 

* - * - 

No observation of instructional activities was reported, however. The 

remaining seven teachers ^indicated that the Staff Development Coordinator 

^had observed the class during an lastructional period « but l>ad focusi^d on 

the activities' of the aide. The Ijipression gained by the evaluator from the 

Protect managers was that' no conce^^trated effort had been made to infuse 'the 

4 

0 

instructional programs due to the contingencies mentioned in Question 2, 

Process Evaluation. The evaluator could only concur that there could have * 

/ 

been little gain expected from attempting to rearrange^instructional pro-- 
grams at raid-year. Nevertheless, It also appeared reasonable to expect a 
greater frequency of contact with Project teachers than was observed. 
TeaHiers themselves expressed the aeed for greater support under tno Project. 
Four teachers, when asked to provide any additional remarV:s which were others- 
wise ^not made in the interview, volui^ti^rily stated that the most critical 
shortcoming of the Project was lacit of support to teachers In organizing the 
instructional programs. 



91 

ERIC . ' iO() 



uxd be ne£ati\ 



/ • _ _ _ 

\ Another area la which the naaAgenenc staff could be negativeXy crltl* 

' ci2«d vaa their failure to solve certain problems which arose early in the 
IJifc of^ the Project and remalneo ^rtfresolved rhroug^iout the yeari Unrest 
whUiTVcAultcd from the assigniDent of cxtra« instructional dtitit^s at Allan 
Juniol High (see Question 1» Process Evalua^tion) is an' example. Anotj[ier 
was the utilization of aides to support instruction in subject areas ojcher 
than reading Cor, at Martin Junior High, mathei&m.ics) 
' The eyaluator wo^ uncertain as to why the Project n^nac^^rii were uiuMe 

r 

^to efficiently resol't^ the prbblens; it was only evideV^ that the problems 
liaU nat ticen resolved a^d consequently *had nod* a detrXmunt.il ijnpact on the 
Project.^ Ulien a developmental project such as Project Assist is placed in 
a school, it must have (o^ gain) the support of the school stdff. Yielding 

to the inconveniences caused by ttie prpject (e.g., adherence to guidelines^ 

- - « 

additional effort required tp collect data for evaluation purposes) is a 
compromise yhich must be made by thtf'^hool stjtf f • Careful and realistic 
planning,^ continiied monitoring of the operation of the project « and quick 
reaction* to those problems which do arise are the obligations of project 
management. In the case of Project Assist, there was a breakdown in one 
or more of those functions. Obviously, not all schools were covpltted to 
following the guidelines of the Project, Furthermore, management nee^d- 
unable to bring adequate pressure to bear upon principals and teachers to 
ensure that guidelines were followed. On the other hand, management was 
less than efficient in monitoring the operation of« the Project. The result 
was a climate which, at least at one school, affected morale adversely -^d 
overall dcttactcd from the proposed operation oPthe Project. 
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Suonary iind Discussion « 

'lite mast notable diangcs which had occurred since January lu the 
operation of the reading and oatheiaaCics components or Project Assist were 
as follows: . . * 

1. Arrangements td^ ^ard glf|: books through the i^F component ' 
and to conduct a Math*in-*Llfe session Lad been made and weri' 
soon to be carrlcjd out. ; * 

2. Except iAx a very small qtiontity wl\lch wa^ .still outstanding, 
those materials which w^re purchased with J'roject funds had / ^ 

been placed in the cldSsr»>oms. 

^: - . - > 

3. Staff development workshops for alde^ had been held monthly 
and* for the most part, were perceived fcvorably by those 
who attended. ' < 

4. Management of the Project appeared tp be carried out more 
I systematically than was thought to be the case In January^ 

t 

5., Steps had been token to stUce ald^s ware of their opportunity 
for ecployment for 1976-77. 

Otherwise, the Project appearf^d to function In essentially the same 

manner as it hdd previously* No dtange was reported In the alloci^tion of 

aides among schools or th^ assignments of aides. within the various <9chool». 

« 

The data which were cQllected indicated that there had been little or no 
.change in work-related .activities ;>f aides. Other than the RIF and Math- 
in*Life components (which were initiated late and, consequently, had been 
reduced in scope), none'^of the instruct ienal programs which were not 
operational in January had been infused. Of course, two reading labs 
•(tlis sixth-gcade BRt/Hoffman lab aad the se^/enth- and el^th«grade EDL 
lab^ had operated at Martin Junior High for the entire year. 

IVo criticisms should be pointed out regarding the operation ot, the 
Project.^ First was the disregard for complying with some Of thte guidel/nes 
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which were proposed for the Frojitct. Infusion of currlculuk^ components was 
abandoned due to contingencies wUlcH hsdf arls^en early In the year /<l.e^» 
late release of funds » d^anges iu personnel » and^h^^acancy for Staff 
Develbpoent Coordilnat:or) Sod^ teachers jEe It compelled to use aides* In, ways 
other than those which had been {trescribed In the aides' Job descrlptl(m. 

» 

Thrse of the four, principals mad(» assignments to aides which were either a 
direct violation of the Job description for aides (e.g.» essigning ^ides to 
monitor the lunchroom during ^periods when they could have been in classrooms) 

or a marginal ^ violation (e.g.» hi^ving a Project Assist aide work In a 

^ * • 

Title I reading lab while the Title I aide provided^ Instructional support 

* * • •» 

to teachers)'. ; • 

^ ' The second criticism^ which is linked to the first » was the apparent 
inability of the Project managers, to either correct the aforemehctoned 
inccmsistencies or enlist the. support of central administrators to see that 
th^ were corrected (see Quest ioc» 4» Management Audit) • As a consequence » 
Project Assist operated in a clitiate which, made it almost impossible for 

• V 

the goals of the Project to be rctalized. As mentioned previously « there 
w^e very definite indications t^t the I'roject Cpprdlnator Was aware of 
these problems and had t^ken or vas about to take steps to bring about their 
solutions (see Quest i<m 3» Manag£,ment Audit). 

In conclusion^ the findings of both the? J«^uary and May evaluations 
strongly suggest that care be ta^^en in the interpretation of the end«ofr 
year product evaluation to be coriducted.by thjl District's Office of Research 
and Evaluation. • For the most part the instructitoal treatment outlined>y 
the proposal for the Project did ilot exist: aides did not re^Ve the level* 
of training which was proposed; teachers received Ao training; some 
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Inscructslonal programs were not Ittplemented at all; other instructional 
^prograns were reduced in scope^ and implemented very late (eveA afte.r much 
of the posttctst data Ifad ^een collected); and instructional materials 
arrived viry late. The^ comments made in the report of the January evalua- 
tipn are still appropriate: 



Thu^;« it would svcm that no decision can dc .xo u for the cur^cat 
Project period rvg.irding tlu uffccts o\ s|HH'ia*' * trained Jnj^truc- 
tional aides support in>'. Lhc- reading and n. lIm ii*. t iCvi curricula 
specified in tlie Troject prcpasal (ixcept, M coi^rne', for the 
reading ia^s at Martin). The hypathesj}/ oL s »^',ri i.it aai f)irogra*n 
effects (a^ specified fn tht; p$pj>osal) tan bo^testeu Cor th^ Martin 
reading labs, butt caro shouJil be^taken to iaentity the target 
populations served by those\labs. , Otherwi.* ej "program effect" 
must be limited by an operational definition as greater support 
of the existing curriculum^ by aides and materials 



/ 



/ 



Ibid, p, lA. 
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Ikiflie 



Title 
Time: 



Begin 



End 



Describe operation of Project sinte January: 



2. ' Diapositidn^of^materiala.^ egulpinenc: 



Project F « Utator 



3. Implementation of curriculutti components by school: 
: - Slw: . - " i 



h 



Oaks Springs /Rosewood: 



Allan: 



Martin: 



4« Procedure of system to. taonitor oper^ion of Project at the Classroom level 
(frequen^X^of site visits » who is contacted): 




5. ?rocedure to ensure aides ar<& functioning according to Job description: 



6. Fre<tu«ncy of contact wit( classrooa teachers (other than staff developoent) 



7. Frequency of contact with building administrators: 
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lOu 



J^X'iakrc^fWjiices vhich' may be rufi«^cted in test scoresj 



1U» (i>l;ilt\l)^valopmfnt Coordinator) Stj^ff d^veiopnvnt aotivitlcii! ' 

Diltj^V Audience ^ Desi rtptl on' y/ * 



\ 



11, Future fcr th^ aides/ 



IZV Attitude toward/Project: 
nontreat 



produce VlRnif leant achlevemait gains beyond 



no slgnlfl4;ant i^ffect 



13^ General remarks: 

I 



Quite 
'.A 



Name 





f 
























* 





Tlae: 



Begin 



End 



L» Assignment of aldesw:. 




Dl«;posiCion ox materials: 



/ 



^ * 



\ ■ 



plHp«>sicion of equifnteiH': * 



i 



4r - 



\ 4« DuCie^ assigned to aides: 



/ 



) 



5^ tU»tribtution of time for aid^s; • 2 instructional* 
6# (atuKict wltli Projact Cpordinator since January: ^ ^yes 



Describe; 



7. Contact with Staff Development. Cobrdinatbrj 
Describe: * . ^ 



% nonlnstructional 
No * 



No 



iia. Instructional support by aides ne^t' y^eaf : 
y i*nstructioival aides presently * 

9. Future of Project Assist aides: 



*# next year 



•er|c 



.1 



10. Di:>sefaLnatian of Project: 
Rmnarks: 



j'lsUs by ATSD pers'onnel 
visits by external exp<jrts 



11, Attitude toward Project: 



j>rodice significant achievement gains beyond 

nontreatment 
no significant effect 



12^ Occurrences which may be reflected in test scor 



li. General remarks: 



;> 
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roacn»jr 



Dale 
School 
Name 
Time : . 



Begin 



End 



1* Experience In Project: 
not entire year 



this y jar only 
other 



.ICS : 



this ye&r and previously In^ 
Project 



2, All m.Vtcrial8 received: Yes No All equipment received: 

Disposition: 



Teachers only: 
with aides: 



Yes 


Ho 


( • 


//) 


Yes 


No 


( 


#) 


Yes 


No 


( 


#) 



Rcmarks^: 



No 



4. Implementation of curriculum components: 

Component 

Classroom ^oral language development • 

^language experlent^e 

^programmed Instruction 

^ JilF 

Lab ^reading/math lab 

m aterials and equipment In lab 

5. Visits to classroom/lab by Project Coordinator: 
Remarks : 



Staff Development 



Yes 


No 


Yes 


No 


Yes 


No 


Yes 


No 


Yes 


No 


Yps 


No 



Yes 



No 



6. Visits to classroom by Staff DeveLppment Coordinator: 
Remarks : 



Yes 



No ( #) 



7. Assignment of aicfes (scdedule) : 
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8, StJfvlces provided by aide: o n<i-on->ope small group r* ^urce, 

t otal class pother ino indent ituu/ 

Remarks: \ 



9. Distribution of aide's time: \ instructional ^ X nonlnstructional 

Remarks: 



10, Satisfaction in working with aide: ^very satisfied satisfi^c 

not satisfied 

Remarks : . * ' : * 



11, Continuation of Project (chough no funds), curriculum components; ^Yes So 

Kesiarks: 



12. la:^trurtion support by aides next year: same level ^reduced level 

J Remarks: ^ ' . * 



13. ^^Occurrences which may be reflected in test scores: 



14. Attitude toward Project: prodt^^ce significant achievement gains beyoad nontreat 

no significant effect ^- 

Remarks: 



IS. General remarks: 
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Schou Time: ^Begtn En4 

1, Educatioaal background: less than high school high school 

' HOtna college ^college other 



Remarks ; 



) ■ 



2. Lxpcrior.ce as an aJdo: this year only in Project ^this ye/r v, { 

\ " pn vlously in Project ^this year and other than project. 

not entire year o ther 

Renarks : 



3. iVsslgnment : one classroom m ore than one classroom _ « r 

- Remarks: x 



4. (Iradc liiVelCs) at which you woik: ^ 
3, Describe^schedule/role in lab: 

6, Subject ar6a(s): ^reading/lan^^uage arts mathematics 

social science sciecpe ^recreative arts other 

If other than reading/math, percentage in ma^ or, areas: 

. — ^ ^ i» 

Remarks : 



7. Instructional contact: one-ot^one small group jentire clast* 

resource independent* study ^other 

Remarks: # ^ 

< 

8. Students with whom have contact: ^ ^all in class lo«st ability only 

Remarks: 



9, Responsibilities other than instruction: grading j prepare materials 

monitor (luiichroom, hall, library, etc.) / 

Remarks : 
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JU. uistrlbiit lun i>l t ink- (while stuJi Mis .*t iUnol): 

X instruct ional i nonir.struct tonal 

Remarks :* 



11. Ins fractional activities with stucenta: ^ 

computation, etc.) r eading from basal/text 



drill (flash cards, spelling, 

workbook, or work&heec^ 



Remarks : 



12. 



Participated in training sessions since Janoafy: Yes 

with t^^hers: Yes 

aides only: Yes 

Remarks : 



No 

"No ( 
No 



■•J 



/ 



13. Benefit of training! sessions: 
• M s omewhat helpful 

Ki^mnrks : 



Jielp very much to do better Job 
"little or no help 



14. Satisfaction in working relationship with teacher (s) 
satisfied not satisfied 

Remarks : 



very satis lied 



15. Position for next y^ar: 



Ki*m;irks : 

•4 



application a^ an , aide 
other 



^position an aiic 



16, Assi-^ance by. Project staff, in emf loyoent for nfext year: 
. Kemarks : 



Yes . No 



17. Attitude toward project: 
Remarks ^ 



has helped improve reading/math skills over nontreatment 
^no telp beyond nontreatment 



18. General remarks: 



104 



Process Evaluation 
for 
Trilogy 
and 

Project Outreach 



Conducted for the 

f— - 

Austin Independent School District 
Mary Davis Mlnter 



105 



OUTLIMi^CP C»NTENTS 



!• Introduction 



II • Overview of Project Assist 3 

* A« Funding Information • #3 

* 

B. Description of Major Program Thrust 3 

C« \suiBnar7 of Major Discrepancies ; 4 

D, ftatential Pr^ob^l^m Areas .Identified 4 

E. Social Considerations •••• 5 

III. Trilogy^/.., 5 

A. Objectives of Component ; ' 5 

B. Background Information . • • • . h. .0 

C. Description of Pro^o^d Plan of Action * 

and tevel of Implementation \. 6 

D;' Major Component Discrepancies •••••••• 10 

^ E. Potential Problem Areas Identified 11 

IV. Project Outreach H 

A. Objective of Component . # • • 11 

B. Description of Proposed Plan of Action 

and Level of Implementation • 12 

C. Major Component Discrepancies ...^^ 15 

D. Potential Problem Areas \ • « ^15 

V. Conclusions ••••«••••«•••• • •••••••••••• 16 

! 

1 • i 

VI. Appendix 17 



Er|c 106 



INTRODUCTION 

This report sunmarlzes Part One o£ a two-part process evaluation of two 
componjests of Project Assist, namely Project Outreach and Trilogy • This 
portion of the evaluation consists of a suxviary of the review of the pro- 
posedj program as submitted to the U&lted States Depaztoent of Health, 
Educajtion, and Welfare for funding, approved program changes, scheduling 
of activities, and the level of present operations (e,g«, mniber of per- 
sons;' served by the components, types of participants, beneficiaries, com- 
posl^tion, etc.)* 

Thls^ portion of the evaluation was conducted primarily through seml-struc- 
tured interviews with representatives of the respective project components, 
project administrators,, school principals, and a limited number of^partl- 
clients In addition, records of program operatlonsJshd planned activities 
of. the respective components were reviewed* Actu^ progtam( activities were 
obfserved also, 

F^rt One of the evaluation of Trilogy addresses itself primarily to the 
f|>llowlng areas: 

Proposed objectives and program focus 

, Chaxiges in objectives and program fo^s 

I Group formation and composition 

i . , ' ^ ' • 

/ Selection of Members 

/ ' ' 

/ Partlcipatiqn requirements 

I Rehearsals and performances ^ 

\ * Schedules 
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D«v8lopaent of skits 
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• Role of froup members ^ 

• Hole of cQASultent ^ 

' ■ ■ ■ \ 

• The development proce^ss ^ ^ 

Pei(t<>K> of the process* will be addressed to the following: 

Actual level of operations (actual and planned performances 

and rehearsals) 
Partlolpants* perceived goals of Trilogy 

i 

Nature of audiences served by Trilogy (based on comii^nent 

^■^ 

records) 

* « 

Reported audience perception of Trilogy goals / 
Apparent benefits to participants 

Success of Trilogy In meeting the goals of the Qnergency 
School Assistances Act; ' 

" ■ / ' - ' > 

The following Issues related t<x Project Outreach will ^e addressed by Part 
One of the evaluation: . " 
^ Project objectives and program focus 

Counseling aild Guidance supervision services. • 

The referral process 

Level of planned activity. * 

< ^ ^ / / ^ ' ' 

Part Two of the evaluation will be addressed /to: 

Indicators of component effectiveness 

Outreach to parents 

Actual level of operations 

Method and plans for follow-u^ activities 

/ 
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Succ«ta of component In meeting tUe goals of the Ekoergency 
School Assistance Act, ^ j . 

It should be noted that the aecond part of the evaluation process vill 
include interviews of Vomponent beneficiaries and pa:i:ticipants and review 
-of 'component records. In addition observations of proposed' changes and ^ 
additional interviews will be conducted with administrators and component 
staff mmbers. ^'^ 



,QVE»yTBW OP PROJECT ASSIST 

Rinding Information ; Project Assist is an umbrella type program which 
encompasses several component "^projects. The program receives funding from 
the United StatSis Department of Itealth^ Education, and Welfare through the 

' ' ^ N c : . 

Emergency School Assistance Act (ESAA), The progr^ is presently funded 

/ 

in the amount of $335, 199. The cwrent funding year began on Sei>tettbeV 1, 
1975 and will end, on June 3C, 1976. ^ ' ' . 

Description of Jlaior Prograg Thrust ; As an ESAA- funded project. Project 
Assli't has as Its major thrust the aiding of the desegregation process 

through the reduction of majority-minority discrepancies In the areas of 

1 , . * 

reading, mathematics, and human relations^ ' Both Hroject Outreach and 

" ■ f ' . , 

Trilogy are directed, toward the area of human relations. In this Arej^% 

fundldg guidelines suggest that proposed projects fall In one pf two cate« 

* • 

gories; 

1) Innoyative, interracial components, and * 



2) Guidance and counseling. 



/ 
/ 
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ProJ^ci >itreach addresses Itself to^the Guidance and eounsettnj^^ functions ' 
and provides for non^scholastlc (non*acacemlc) ^service's. Trllpg7 serves as 
an Innovative^ teacher-training model designed to provide favorable impact 
upon the attitudes of teachers as well as stixdents a^ others Involved In 
the desegregation process. . 

Rirther Information on the Individual co«q>ontnts will be found In subsequent 
sections of this report which address specific aspects of the z:espcctlve 
conponents. ^ , , 

Kaior Discrepancies: The appllcatlon^for funding for the ctxrrent period was 

submitted to the U.S. Department of Health, Education, and Welfare In ^rll,^ 

1975 • While approval of the program was ' IndlcatjKd as early as June, '1975, 

formal approval was nbt received until late August, 1975* Actual funding of 

the program Was not received until September, 1975. An amendment was sub« 

nltted and approved In August which reflects necessary budget changes re- 

■* • « 

queft^d as a result of the late fundlng^ situation. I 

P&tentlal Problem Areas Identified ; Project Assist and,, consequently. Its 
components - Trilogy and Project .Outreach - suffered temporary setbacks at 
the onset of funding as a result of the resignation of the project director ^ 
(Se^ir#iber 8, 1975). 



On October 13, 1975, the Staff Development- Specialist was officially Assigned 
«dual responsibilities as Project Coordinator an<i Staff Development Specialist* 
This dual position was continued tfirough January 19, 1976. ' As a result of 
this Administrative difficulty, boih intra- and Inter -component conounlcatlons 
appears to b1e less than optimal. ^Idence of conmunlcatlods problems were 
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Vi%t «pp«r«nt In the Trilogy component as reflected In rumors that the com-' 
p6ii«at «oufd be discontinued (sone thd^ght the extension of the project had " 
already been .discarded 'since there had pot had any activity at the <«lfaBentar7 
Itvele r^ck of Information dissemination as to perfdrmaface schedulaa and 
plans for involving persons at the px^ect schools, schedule and project- 
changes I and conflicting ini^ormation about the project? at various levels^ of 
the project. 

Special Consider at iona ; This portion of the evaluation process vas conducted 
.during the planning period for the 1976*77 program and funding year. Pro- 
posed changes in the project coiqpon^nts will be included in Part Two of the 
€Vcluation« 

TRILOGY 

Oblective ; The objective ^of this component is stated in the request for 

funding as follows: 

^*At the end of the instructional period (May, 1976) itt tcSst » 
- ten percent of the faculties of the project schools will score 
significantly higher on a late spring 1976 post test admlnis-* 
.tratlon of an Ethnic Attitude Instrument than they did on an 
early fall 1975 pretest administratiod of the sjoie instrtnnent." 

Levfl gf Implementation ; This objective was changed (elimlxia^ed) after re« 

view of the proposed measuring Instniment reflected that the instrument to^ 

^/ ' 

be used was a measure c^f "locus of control" rather than one of ^'ethnic atti^ 
*' . • / ft 

tudes". At the time ^f this evaluation, the staff of the Office of Research 

-/ 

and Evaluation and .tide Staff of Trilogy were in the process of developing new 
project objectives. This area will be reviewed in Part Two of the evaluative 
process. 



/ 



BacMa^ound Ittforgmtlon : This component Is proposed as an ^extension o% the 

/ 



/ ' • * ! 

^evlottsly ESM^-funded Trilogy to selected elementary and Junior hijpb pro- 

Ject schools. The original Trilogy Is a component of the Austin ISD's Dlvl* 

slon of Human Resources , Conaiiilty Liaison Program, also funded by ESM. 

The project name reflect'b the major cultural composition of the project and 

of the Austin cdtaaunlty. It refers to the integration of Macks, Chicanost " 

and Whl^ei. / - ' . 

- ^ 

Trilogy lii seen by its creators as 1) ^a creative laboratory Ip Integra- . 
tlon", a^demonstratlon Of ^good faith efforts'' in assisting Qthers'with the . 
problems of Integration; and 2) the "Involvement oi people In' lntegratlon'% 
a first-hand experience of "successful Integration*" 

if 

The Initial com^nent conslsM of Comnunlty Liaison stafpC, students from se« 
veral high schools and one Junior high school, and" teachers from these' school. 
Those schools currently participating in the original coiqponent iuclude LBJ 
High School, Austin lUgh Schobl/Lanier ^hc School, and Bedicek Junior High 
School. None of the proposed project. schools^^particip4ted in this phase of 
Trilogy. ^ 

DESCRIPTION OF PROPOSED FLAN OF ACTION 

Focus of Componeftt ; This component* is designed to depict a variety of student 
teacher*admlnlstrative sltuiiions in su^^ a way as to illuminate some of the 
preisures, problems, and positive encounters experiences in a multi-cultural 
environment, as portrayed by sttidents and teachers of^the project schools. 
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Tht primary Wfh^utp of the program Is to serv^ as a teacher-training n9d^l* - 
la addition, it Is to focus on the attitudes of educators and the skills, 
language patterns, and prl^blem sltniatlpns of the students. 

Levy 1 of Inp lamentation ; No major changes or discrepancies are noted In the 

iatended "^f ocus of tlie exponent, ^e "component , hovever, has not yet become 

* ' • * 

operational on the project school level; 

Composition ; The group, will be- trl-ethnlc in nature, tt will consist 6f - 
students and teachers from the following schools: Martin Junior High School, 
Allan Junior High School, Oak Sprixigs Elementaxij; School, Rosewood Elramintary 



SchMl, and Sims Elementary^^hool« 



Latvel of Implementation ; At the time of thls^ evaluation, none of the elempn* 
tary project schools had partlcli$alted in the projet^i Likewise, no partici* 
"^^^v^nts ha^ been recruited from the junior high project schools. The first 
pr<lrformance at any one of the project schools was Iwld on January ^2r,. 1976^ 
at Martin Junior High School. One purpose of this peri<mumce was ^to recruit 
new mea^ets to the group from Mar^n Junior High School rad from^ elementary 
project schools ^^ch were to be Invited to the performance. In addition^ 
this ey^nt was to serve as a preliminary activity for initiatl]^ the devel- 
opment of perfonaances' and topics related to the elementary prbj:ect schools. 
< . , I / • 

Information gathered from the el^imentary school principals and ftom the com* 
ponent staff were foiind to conflict. The princit^als Indicated that they were 
unaware of the performance at Martin JRS and were unaware that any of the' 
elementary, schools had been Invited to attend. The principals ^indicated that 
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tlMre vttr« no itudenta from the •lementary project schools attending the per- 
foTMnce. 

ilecrultaent efforts resulting from the performence at Martin JHS wer# not 
available at the time of this report* 

The conposition of the existing Trilogy group reflects a teacher*student ra£io 
of 2 teachers. /13 students • There are^ also three adult nenbers from the Com* 
. aunity Liaison Staff. 

The ethnic composition of the group is as follows: 

Black Chicano White 

Adults 1 2 2 

Students 6 5 '2 ^ 

TOtALS 7 7 ' 4 , . 

This ratio is thought to be a result of the selection of schools ritthet than 
the projisct go^ls or the recruitment efforts. 

Selection of Participants ; All new meiid>er8> whether teachers or students > ^ 
are req^lfed^to attend or participate In at least three perfojniiances or prac* 
« tlce sessions before being voted into m^ershlp by the member! of the group. 
The purpose of this procedure is to acquaint and orient the prospective mem* 
ber to the demands > procedures » obligations » and the '>urpose of the group 
prior to the prospective member's making a comnltment to such obligations* 

Level of Implementation : Since no members have been recruited from the pro- 
^%ct schools at this tlme» revl?/ of the selection process Is inapplicable 



ERIC 



thu tlm of thm •valuation* 



Kthtttgali ; Retuarsals ere held once or tvice a week from 6:30 to 9:00 In 
the evenings. The reheersels were previously held on Saturdays. Thin was 
cheaged by request of the pertlcliMints. Generally when new materials are 
being learned or new skits are being planned , the rehearsals are held more 
frequently than twice a week. 



Level of Implementation : Review of the process Is not^needed until the com*- 



poaent becomes operational at the project school level^ 

Performances : The application for fiuidlng states that: 

"In addition to performing dur,lng preiervlce training t the 
troupe will offer presentations on a quarterly basis on the 
project canvuses and one performance for each campus PTA." 



Level of Implementation : To date only one performance has been Iteld on the 
campus of a project school. One purpose of that performance was to recruit 
persona from the project schools to Join. Other project schools were to be 
invited to the performance. 

It should be noted th^j: attrition problems involving "inenbers of the original 
Trilogy group has delayed progress toward this planned level of perfdrmance. 
On the original participants, six of the 15 members dropped out. In addic- 
tion^ three mend>ers of the C@™mlty Liaison staff who participated in the 
project were also lost from the project. Six new members have been added t 
including one new teacher. ^ 

Development of Skits : It is planned that a 15-minute performance will be 
developed for use with elementary school audiences. The regular performance 
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Is omuilly about 35 nlmitts in Ungth. ' It is expected that students and 
taaehars from tha projact school^ vill ba usad as rasourca parsons in idan* 
tifyim appropriata situations and problams ancountarad ^Hilch ara ralavant 
to tha audianca baing addrassad bj tha parfomanca. Tha consultant vill ba 
uaad ^0 halp organisa tha matarials and to assist in planning tha parforaanca. 

Laval of lanlaaantation ; This aspact of tha projact has not yat bacoM opar* . 
ational. 

Raplicabilitv ; Tha cooqxmant proposal for funding statas: 

**%ilog7 will prapara for and parfom on'KLRN (a local aduca* 
f tional talavlsion station). Thasa programs will ba uiad a 
focua of classroom lassons snd will ba mada #vallabla nationalljr 
through tha national Public Broadcasting Systam«" 

Laval of laplamantation ; This aspact of tha projact has baan changad* Sinca 
tha axistlng Trilogy is preparing a talavlsion prasantatlon with tha Soutfairast* 
Educational Oavalopmant Laboratory in conjunction with ona of tha ESAA«fuzidad 
projacts of tha SE3)L, it is axpactad that tha nav componant will bacooM in* 
volvad XvL tha sama arrangcnant. 

MAJOR COMPONENT DISCREPANCIES 

Tha Trilogy componant of Projact Assist has not yat baconv oparational. As 
a rasult of this fact, many of tha plannad intarvlav ^questions are not appli- 
cable at this phase of tha evaluation. Since the project is to be modeled 
after the existix^t Trilogy project » information has been included as to tha 
method of operations and program development in the existing component* 
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▲aptcts covered in thl« phaee of the evaluation process which were found to 
be Inoperable will be reviewed again at the time of the second phase of the 
evaluation process. 



POTENTIAL PROBLIM AREAS 

i 

1. Ttkp' schools selected for this cooiponent 4iave student populations com- / 

• ^ J . * . ' 

prised of more than 90% ^orltjt students • It appears unrealistic to; 

esrpect to recruit ::nd maintain a "ttl-ethnlc" student group from such 

population. Since the faculties -o^ the project schools are more repre- 

sentatlve of the three major groups « this problem area does not appear 

to exist at the faculty level. 

I 

2. Lack of cooBAinlcatlon among the various levels of the coiqKment, pa^* 
tlcularly with the Indlvldtul project school administrators, Is likely 

. to result in lack of enthusiasm and interest in the project on the part 
of such persons « 

3. The delay In initiating activities at the elementary level clearl:|i^ in- 
dicates one or more weaknesses in the capability of the project 
expansion br extension at this time. 



PROJECT OUTREACH 

Objective ; The proposal for funding of this component states the fallowing 
objective: 

"By tluk end of the instructional period, September, 197$ • May, 
1976, at least 33% of the students referred for social services 
will have Improved in the area(s) for which they were referre4, 
i.e., attitude, attendance, interactional skills, etc., as mea* 
sured by records kept by project staff throughout the year as^d 
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by teachtr qiMStloimalres administered at the end of the Fmll 
^ and SpriiMl semesters." 

Levi of project has not yet been completed at the time 



of the evaluation. The measarement of this objective vill be made at the time 



of the Outcome Evaluation being conducted by the Office of Research and Evalua-* 
tiOB. Presently 9 hovever^ there are approximately 277 of the 300 students at 
Oak Springs El^entary; 107 of 130 at Rosevood; and 100 of 496 at Sims S^ool - 

being served by this project. It is noted that the populations of the Junior 

« 

high schools are less stable and that interns are assigned to vork either at 
a direct services level pr at an organizational and conainity level t ConM* 
quently» measurement of the exact number of beneficiaries at this time U quite 



Students referred by the counseling staff of the project cseoipus are to receive ^ 
aervices through one of three basic approaches: 
1« Individual Counseling add Guidance 

2. Group Counseling 

3. Outreach to Parents. 

Level of y**p''fT^ntation : There is only one major change noted in the opera* 
ting procedures. In the fall semester » interns did not specialise in provi- 
ding one type of Service (i.e.^ direct counseling services or services through 
connmity organisation^ and agencies). In the spring semester » hoirever^ spe* 
cialised assigtmients have been made* F\irther explanation Is included later. 



difficult* 



DESCRIPTION OF PROPOSED ACTIVITIES 



r 
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Thii tta intwras ixnrolvttd In tht project are assigned to the folloirlog schools; 
Slas School 2 
Soscvood School 3 

Ariaa^ Jr. High 2 ^ ' 

Martin Jr. High 3 



TOIAL 10 

There are no Interns assigned to Oak Springs Elementary $<!^ool* Instead t esi- 
phasls Is being given to ° Rosewood School. r 

Foctts of Major Activities : The focus of the counseling process varies by pro« 

4 

Ject school. The project emphasis, by school. Is as follove: 

Rosewood: -Behavioral problems (specifically attentloi^? ^ 
getting patterns). 
-Interaction of teacher/pupil 
-Problems related to the absence of positive 
male Images 



Sims: 



-Problem types run the gamut here. 
Major esnphasls Is thought to be directed toward 
family and economic problems. 



Allan: -Attendance 

-Beliavloral problems 

Martin: ttendance 

•^Developmental problems (e^g. , bodx^consclousness 
of girls In physical education program.) 
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P#fCTiliiiiit Appropriaf Actlvitlci ; When'sttiduts «r« referred for 8«rvlc«s 
thm eoouttllng staff of thm project school and tha interns assigned to the 
school determine the proper activity placem^pt of the student. 

V 

The project director provides a sourc^ of consultation services. 



It is noted that both placement of students and the level of ^services re- 
ceived are affected by 1) the caseloads of the Interns ^2) irir^ather the 
student is receiving direct or indirect services (Please note that interns 
are assigned to one of two levels; either Counseling services (direct) vith 
the referred individual students or with student groups j^or Organizational 
and coonunity services. In which the Intepi works with p|u:ents or teachers 
or relatiid organizations in the coinnunity ^AdLch are also seeking to sddfess 
the attendance/behavioral problems of the -students from the project schools) 
or 3) the major focus of the project. 

The Referral Process ; This referral process is not clearly outlined In'^he 
porposal for funding ho in later project descriptions. It is apparent that 
this has been done to allow for needed flexibility in meeting the needs of 
the Individual schools in the project, iche differentiation of needs by pro- 
ject school is reflected In the variation of project focus by school. (See 
"Focus of Major Activities" for this component.) 

Levfl of Implementation ; Most referrals for counseling and guldsnce services 
are made through the school counselors. In some cases, the prlndpaf or tea- 
cher requests that the intern work with a student. Whea it is found that a 
student works well with or responds well to a given adult, identified as a ' 
'*key person", then the intern may work through the key person in dealing with 
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tlM pvoblaw of tha child. There are tcmm caset in which "target client a" 

are i4eiitifled by the interna at hanging behavioral probleiBa that are thought 

to **pott&tlmll7 rtsponslvm" to counsollng mad guiduce servlcot. Tho 

approval of tho school counselor or principal is then obtalnod and tha child 

bacoMS a cliant. 

'\ • I ^ ' r ' 

lacords of rafattals vara not raviewad during this portion on tha avaluation 

procass. Such raviav vill ba conducted In tha subsaquant raviav session. 

A copy of the format for aiieh recorda ia included in the appendix aection of' 
this report. 

MAJOR CGMPONENT DISCREPAMCIES 
No Mjor discrepancies were noted. 

i - * 

POtEMTIAL PROBLSI AREAS 

One possible probl» area was noted. In the coonmlty and organisational 
aspect of this cooponant, there appears to be som confusion as to the role 
of the Intern and/or tha siajor focus of this aspect of the progran. Should 
this confusion actually exist on the part of tha intern, tha effective^ss of 
the progran might ba diainished considerably. 
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CONCLUSIONS 

Both Trilogy $nd Project Outreach have, of necessity operated vltl^ con- 
siderable autonocty due, first, to the absence^ of a project administrator, 
and later, to the dual responsibilities of the project adainistrAtor* 
As a result of this administrative difficulty, Ttilogy, already suffering 
from the attritietTof staff and strident s, has failed to initiate appro« 
priate activities directed ^ard extension ^f^the component into nevly 
deiignat*d project schools. Project Outreach, on the otiier hand^ has 
continued to grov and develop and had become more autonosioua in its oper- 
ationa. This may be due to the fact that this project has been opera- 
tional for five years and has maintained greater stability at the super- 
visory level while continuing to train new litems* 

There appearii, to be a definite need for increased and improved conaminica- 
tions at all levels of the Trilogy cooqponent* It is suggested, hovever, 
because of the various responsibilities and differing priorities of the 
school principals, that primary channels of communication be tied t(i 
those established for meeting the provisions of the new drama require- 
ments for the elcsmentary school (TEA 5160), in which elementary school 
teachers will be requii^ to teach dramatics for one hour/day. 



' APPENDIX 

Iat«ryi«ir Qu«ations for Trilogy 
iQttrvtw QMStiont for Project Outreach 
Scheduit of Valuation Activities 

/ 

/ 
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IMISRVIBr qOESTIO^ 
IDR 

■ i ■ ■ ■ - ' . 

1* B8V« thmtm 1>««n «&y «Miida«it« to the original proposal? What li tha 

affaetlva data of such anandmrati? 
I. Nhat) la tha natura of tha asseisotnt (rafarral) procass? What procaia 
X^aad procodurae ara uead to davalop plans for V^satnont? Ara thay 
_ standard (uniform) for all partldpaiits? \ 
i. What typas of taeords ara usad? . ] 

4. Miat ara tha Indicators usad to detarsilna aaeh of tha appropr^jita ^ 
activltlas? 
. 5. What Mtbods sra usad to datamina 

a) tha approprlatsnass of tha Indicators * . ^ 

b) tha affsctivanass of tha assi^iad activity (lss)« 
6« Eknr sra changas affsctsd as a rasult of tha instnoBsnt «ployad7 
1. At what points in tha activity schadul# ara ^icators ufad? What 

ara tha Intervals batvaan assassasnt periods? 
8* What procedures are usad to assign interns? 
9, What 1» th« nuab«r of lnt«rn8 asiigMd (by ilta)? 
10, What «r« th« rolai of the Interns? 
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immvmi questions for iililog? componemt ^ 

r 

1. Bm lt/v«s tha group foned? 

2. * Bow Imltticftd is tlui ethnic cooposltion? 

3. Mut Is thm balance of tetchert and studenttt 
4» Bow intro/cre ackers tolected? 

5. Nhat processes ere followed in developing skits? 
(etg.» use of group nead^ers. resources; encouregsnent 
of Initiative -taking, cooperation, etc.) 

6. fftiat do participants perceive to be tlUt goals^of trllog 

7. ' .Bow often ere perfomences given? 

8. To what .types of wdlence are perfomances^resented? 
(e.g«* proportions or performances addressed to student 

audiences; teacher aiijllences; parents; other coanunlty 
groups, etc.) 

9. Bow often are rehearsals held? . 

10* ^ Does the tine spent on Trilogy se^ to coBq>leDMint or detract 

froB other school work? 
11. What benefits ere apparent to participants from their being 
% In Trilogy? t 

12«. In what ways doet Trl^ldgy succeejf In furthering the goals outlined 

by the ESAA guidelines? 
13. In what ways are these goals not furthered (obstructed)/by this 

cooiponent? 



125 

134 



icHEDULE OF BVAtUAtlON ACTIVITia; 



HtttttljKiig with lUpreaentatlye froa^ Office of 

RAtMTch and Evmluatlon 
irnvtw of Project Ixiformetlon 
Meeting with Director of Project Assist 
Meeting with Director of Trilogy 
Meeting with Principal of Rosewood and 

04c Springs Elementary Schools 
Meeting with Principal of Sias 

Elenentsry School 
Meeting with Principal of Martin Junior 

RLgh School 
Observation of Production of Project 
Trilogy 

Meeting with Principal of Allan Junior 

High School 
Meeting with Director of Prbject Outreach 



Jan. 9; 1976 
Jan. 9*16, 1976 
Jan,. 20, 1976 
Jan. 21, 1976 

Jan. 23, 1976 



Jan, 27, 1976 



Jan. 27, 1976- 

Jan. 27, 1976 

Feb. 3, 1976 
Feb. 4. 1976 



In additl:>n to these laeetlngs, other meeclxigs were scheduled ^th repre- 



sentatives of the Office of Research and Evaluation as needed. 



\ 



Process Evaluation 
for. 
Trilogy 
and 

Project Outreach 



Part II 



Conducted for the 
Austin Independent School District 

by 

Mary Javis Minter 
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Outline of Conte nts 



0/*?rview , 1 

Methodoloi^y • , 1 

rilo£ty , U 

3«ckff:roun(i Information ^'^ 

Sumrn^jry of r.:?ijor Component Changes f> 

Identification of Tar*?:et Schools 

yOnT:)0':i ti on 'irilo^:-^' ^"^oud, . * 

jeveloumont >rGsent5^ tions fcr Tare;et' Schools. . 7 

Budce t Chan5:es 7 

Actus^l Lev^l of Operations • 8 

Me^isurement Techniques to be Used 9 

Ms9,ior Problem Areps • « • 10 

S^ecl^l Considerations! ^^astside Express 12 

Project Outreach \... 15 

Back/^round Information. , IS 

, Objectives , . . , I5 

Chancres in Pro-am Focus 1^ 

Level 0^ Operations (Direct Services) 16 

LevRl of Operations (Indirect Services) 19 

Indicators of Component "Sf f ectiveness 20 

TMajor Problem Areas 21 

Conoluaione • 

Attachments 
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Process Evaluation 
Praject Outreach and Trilo^:y 
Part- II 

Overview t This evaluation consists of two parts. ?^rt I was 
conducted in J^^nuary, 1976. It included a summary of the prof3;ram 
«is proposed to the United States Dep?»rtment of Health, Kducation, 
ftnd Wel^5*rei the approved program chanc:esj scheduling: of OT)er- 
«tionsi ?^nd the level at whic^ the respective components were 
beini^ implemented. Part I pro. ded detailed descriptions of the 
program activities and identified changes in the funding; pro- 
posal, A comps^rison was made of some aspects of the actual 
component operations and the proposed plan. 

Me thodolo/yy t Part II of the evaluation was conducted in liay, 
1976. The process used to conduct the' evaluation included 
semi-structured interviews with component administrators, 
school ^^dministrfl tors , counselors, teachers, and social work 
interns. In addition, records of actual operations schedules 
of activities, and written reports were reviewed for information. 
Thid T)ortion of the evaluation process addresses the following: 
asr)ects o^ the respective components. 
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Trilopcy 

?iumm5?ry mjor changes in component 

Ob jPC t3 ^''^S 

- i^l^nti-^ics^ tion of t^rp^et schools 

- oonnosi'tion o^' Trilo^-r " -oui:) 

- 10—-^ it o'"^ n>-esent?^ tions for V^r.^^t scnoo]? 

Actual level of operations 

- number of actual performances and nature of respective 
audiences 

- Number and type of direct beneficiaries 
Measurement techniques to be used 

--objective measures 

- Sub.iectivf^ measures 
Problematia^ asDects 

- lack of self-direction 

- absence of strong: planning component 

- need ^or input from project scj^ools 
St)ecial considerations! Eastside Exprcf^s 
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Project Outreach 



Ch^mires in program foc:i«: 



Level of operations 



- liirect services i 




- indirect sein^ices 

In^iicntors of componej^u effectiveness 

- objective mensu^es 



- sub.iective measures 

/ 



n^jor pro.blen areas 

- component knowlsdp;e of budgetinp; process 

- lack of nnace for interns 

- reassiccnment of inte^i'^ 

- methods and olans far followup 



m 
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Trilogy 



Background InformRtion i The director of Project Assist was 
♦ 

appointed approximately five months afxer the pro.j-!vvl ^.ir-."--' ■. 
( j^e Part I of the evaluation Report for complete oetail:;). iri 
orylv,/T to p.et the project "off thfe. grpv«i£l!li^f ter several ma.ior, 
hut unavoidable delays, the new dir^qtor assif^ed highest priority 

r 

to operation^lizing the instructional components of the project. 
The Trilofi^y component, being a non-academic component, received 
low priority. In meetings with the Program Officer from ESAA 
Reflfional Office, the director requested approval of a chani^e in the 
focus of the component. It was agreed that the component would 
serve only as a teacher- training model. The change was approved 
and effected in April, 1976. It is important to note that this 
change occurred approximately eight months into the project 
year. The corresponding changes '(i.e. , changes in objectives, 
target schools, etc.,) will be noted in subsequent sections 
addressing specific details about the component. 

There are no funds budgeted in the component for the position of 
Component Coordinator. This position is funded through the liSAA 

Basic Grant. Understandably,* the coordinator 'has ^directe 

of his efforts toward the activities of the Human Relaitions Division 
which is funded through the ESAA basic Grant. 
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The lack of direction afforded by the Project Administrator during; 
the course of U^e'year^ the loss of lead-time, and the lack of self- 
direction within the component has resulted in failure to recruit 
participants from the project schools. Efforts to operationalize 
the component have resulted in a spinoff project being ore;anized 
at Martin Junior High School. The absence of performances at 
Allan Junior High indicate that no efforts were made to recruit 
participants from this project school. Following the approval 
of programmatic changes affecting the overall direction of 
the component, primary efforts have been directed toward initiating: 
involvement of the elementary schools in the teacher- tr'aining 
efforts. The ma.ior involvement at the junior hi*;h level has been 
throuch sissistance to "Eastside Express", the spinoff project 
•«t Martin Junior Hiph. Sastside Express will be further described 
in the "Special Considerations" section of this report. 
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^ Summary of Major Component Changes ^ 

Objectives t The objective ,of this Gorapcnent', namely the changing 
/ of Attitudes of faculty and students, v;as deleted prior to the 
-initial evaluation report. There T.s presently no stated ob..iective 
for this component. It is expected that the objectives will be 
\ clearly delineated following this tranistory phas6 of operations. 
The focus of the component has been redirected. The ,' 
, project initially sought to focus on making administrators, 
•faculty members, and' students aware of the various pressures j 
uroblems, and special encounters resulting?; from interactions 
«monK and experienced by racial/ethnic groups at each of the 
three levels. The component is now focused on only the faculty 
members of the tarp;et schools. There are no direct scuotnt 
benff-fits or iivolvement of students «it th'; oroject schoolc 'w' -- 
-^1,0 p-tc^ntio i o" ;> ''tii! .Ji).,-.i Or- X^\\ Inhool, '.vlicro G^jiriO*'^' 01' 
'>11o'ry has b'^en or<ranized. * 

Idrntif iotion oT Target Schools » E-ive schools were initi,ally 
identified as target schools in the original proposal. ^Only 
four of the schools are presently being served by the project. 

,.-,....-.-:-^li^,!^_ ^jun4or lii^ School ^.i^ being servsd .by this compojnent. 
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Composition of the Trilo/ry Group t The proposal indicated 
that Trilo^ would consist of students ani teachers fron each 
of the target schools. The change in objective as indicated 
in the previous section has necessitated corresponding; changes 
throughout the component, including a chanfre in the proposed 
membership of the troupe. As a result of such chaneies, only ^ 
the troupe as organized and described in Part I of the Svaluatio 
Report is operational, No new members have been recruited from 
target schools. 

Development of Presentations for Tarp:et Schools i There have 
been no- special presentations developed for presentation to 
target schools except through the efforts of Hastside Express, 
which is not limited to target school audiences and/which is 
not a direct activity of Trilogy, (See Special Considerations 
Section for additional details,) 

Btidget Changes t The budget consists of ,^,500 for 'consultant 
services and IS^^O for travel costs for consultants. Since no 
new productions we^e developed and no new menibers <Fecruited 
from target schools, these funds have not been needed au planned, 
Consequentiyy consultant services have been provided for "rJact- 
side Express", Such changes 'a ere made locally since the funds 
are still being used for consultant services to a target school 
and members of the. cast consist of students and teachers from 
the school, 

'\ ' 
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Actual Level of Operations 
rofL^jtupl Performances t Three performances » have oeen 
c^niucted for target schools* Those performances and their respec- 
tive audiences are identified in the following schedule 




I^>ate 
Jan. 27 

Jan. 27 

May 6 



Location 
Martin Junior High 

Martin Junior Hi^ 

ry 



Audience 

Students and Toachers 
(7th Grade) 

Students and Teachers 
(8th Grade) 



Elementary Teachers 
(Kosewoodp SimSp and Oak Springs 



Rosewood Elements 

Direct Benef iciariesii^ The audier^Qes of the performance es are con- 

i / ' * 

sidered the direct bej^ief iciaries/ of the component activities. There 

j / • , 

have been no perf ormainces made for PTA groups at target schools as 



initially planned as 
and focus. ^ 



a result of the change in project objective 



Me?isurement Techniques to be used to Determine Component Success 

\ 



Obie'cttve Measures t A questionnaire has 'been developed for 
?!udience r^SDonse to serve a measure of component success. 
(See Attachment A: ,Reacti6n "to Trilop:y for format and content 
of the questionm^ire, ) \ 



A second measure to be used will ba the frequency of roquects 
for presentations from target school^ and the size of the recpcc- 
tive audiences attending the oerf ormances. 

Subjective Measures i Word of mouth comments » input made on a 
voluntary basis from program observers, and volunteer efforts 
at joining the troupe will be considered subjective measures of 
comobnent success. 
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Major Problem Are?^s 

L---^^- — ^ ^'-~...z.==:^=,:=======^ 

Lffck o^* Direction : There has been a definite lack of direction 
exhibited in this component.' This is evidonced by the absence 
of activities at proposed target schools prior to the aopoint- 
' went bf a full-time administrator for Project Assist 'and by th^ 
minimum level of activity found in the subsequent period in 
which the administrator's attention was directed to the instruc- 
tional components of the pro,iect7 7The lack of activi1;y nay 
have resulted from extra precautions being taken by component 
staff in an effort not to overstep the authority afforded them. 
It is expected that this problem will be remedied since there is 
both a project administrator and a staff development specialist 
to provide f:uids»nce and assistance to the components t Also, 
since the instructional components appear to be operation^^l 
at this Doint, it is expected that additional attention may 
be afforded thfe Triloey component. 

4 

Planninf; V/eaknesses i The planning aspect of this component 
appears to be extremely weak, particularly the lonf:-tenn plannin/r 
that should occur within the component. There is little evidence 
•of input from tl^e urincicals and T)?^|«;ici pants of target schoolf;. 
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'.^rnil* the principals generally agree that they want to be in- 
eluded in "special projects" of the school district such as 
^Pjg^l^iryv-lt i^^^ ^ the need for such joroiec ts wi 



aj civen t«,rc:et school is not the result s^^ needs assessment . 
Dlanninff or other planning efforts initiated or ponducterl by 
the administrators or* staff of the individual schools. It 
is U\^-' opinion of tnis evaluator that some of the Droolcn 
i/^enti le*. in Part I (p#ll) of the Evaluation Report, such as 
\^he selection of schools and intra-pro ject communication , are 
d\riect consequences of the lack of "pre-program" and on-/roinp; 
inpili^ ?*nd the subsequent "lack of commitment" to the component 



on the Dart\ of administrators. 

It is re^prnme^ded tW&t a time schedule be included in the olanninc; 
process Which' would ' indicate ^"target dates" for skit' development, 
scheduled r^^he^sirsals , performances, repruitment goals, etc, , ta 
be completed •\ This scheduling should also include planned poifits 
for coordination and communication with target school personnel ♦ 
Likewise, speci^iq information .should be provided regardin/^ the 
description of the activity, quantifiable results to be expected, 
and the dates by which such results should be completed. 
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Special jConsiderations 

« 

On^JAjcuiaiyLJt'^ t 1^7^> two perfo rtnance o f Trilogy were he 1(1 at- 
M«rt^h Junior Hiffh School. Ms. Linda Vozelle, formerly a member 
of the Triloey cast and presently a teacher at Martin Jr. Hipht 
observed the Derformances and 'became interested in developing 
a similar proe:ram which would focus on positive aspects of the 
^astside of Austin including. community and school problems. 
She organized a group of 19 students from tlartin and checked 
with members of the Trilogy staff for assistance. 

It was decided that the consultants thaD were provided^ by KSAA 
fumUn^r for the Trilogy component could be better utilized by 
Drovidinc consultant services to this project school since no 
new presentations were beinf^ developed as initially planned in ^ 
the Trilo^ty proposal. Consultant services wer^ then provided f 
twice a week for the four weeks preceeding the first performance. 
Consult^»nt services included assistance in rhythm, ^pacingt 
timing,- and in fittin^r the complete performance together. Tv/o 
additional sessions were held between consultants and the three 
adult sponsors of the project. 

It was decided that the focus of the project would be on the 
classroom for this year. Presentations would incluuv. Information 
about what teachers .do that "buff" stuilea^.-s ;^n; wn^t yLu ^^j.;./. iO 
that ">ruF" teachers. .Discussions woul i hei'd concer-iin- Ir/^ ^ 
pn«lvsef5 o'^ v/hv. such behaviors occUr. 

ERIC . . mli':} , 




1 ■ ^ ■ ■ - 

Th^ c^ist. include students who are -""model" students and students 
th*t ire sometimes c|on8|dered "problem" students. The criteria 
selection iVicludea the following t ' , ' ' 



p-vyi^tftF ^e other studente = 



* ' f and adults I 
, [P^l • the individual roust attend rehearsals i ' 
- the individual must attend the performartcesi 
\ - students who must be out of class for a performance are r«- 
\r quired to make up the worki (It is the teacher's respon- ; 
sibii.ity to report problems to the sponsors of the project.) 
. - - paren^^ approval is necessary. • ^ 



he following schedule was used in planning^^r the presentations t 
^ - tryouts I (three weeks) 10 students were heeded i 21 were 
*i .chosen. 
- rehearsals prior to first. ^erformancjei (two weeks) 
• development of skits and: u?r6 tof consultant timet (four wefeks) 



Input from students included suggestions for presentation topics, 
and skit planning. The production was to be called "Eastside Express". 



Contacts with parents has increa^eu the invoivement of parents 
through their presence at th*? presentations. 



t , 



There were five performance that had been conducted prior to the 
evaluation visit. The performances were held at the following 
locations. 

- Martin Junior Hi«h School (2 performances) 

- fartln Psrent-Teacher Association 

- D«wson Elementary School (5th jrrade classes) 
; - Metz Hl-,(nf »ry School (5th grade classes) 

Pl^ns «re being made to focus on the Sastslde community for 
r c ' year. 
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Project Oat reach , 

B>ic1cground Infonrotion i This on-going project is funded pri- 
marily through the National Institute of Mental Health as a 
training program for social work interns. The position of super- 
visor is provided through the University of Texas at Austin t 
The ^AA funding of this component provides for consumable 1 terns 
for group work and play therapy (^550) i non-consumable items for 
group work (olOO)i consultant services (3200) i and travel for 
the interns (o576)t No funds .are provided for salaries of 
interns • The component represents a cooperative training pro- 
gram, and supplementary social services between the University of 
Tex»s and the Austin Independent School District. \ 

Ob.lectives t v.ie genei^l ub.iectives of this component are to 
"^iiBlirroVQ ,T)UT)il attendance, to improve attitudes toward \chool, . 
and to iifeprH)'^ (interpersonal) skills of students. 

The. emphasis 1^ focus of the component differs according to the 
rteeds of the particii>ating target schools (See Part I of the 
'"valuation Report). Program changes resulting since the pre- 
vious report are included in this report. 



Changes In Program Focus t It is noted that the component rwas 
ori«;in«lly desired to serve only problem studentSt This, was 
changed when interns became aware that the project was becoming 
n "reward*^ or incentive for negative behaviors, since only problem 
students received the reinforcement of being out of class, working 
with the intern*, participating in the interesting activities, etc. , 
As a result, changes were made to correct this (e.g., developing 
^ special component to include **model students**, such as a school 
newsiwper, Involvement of non-problematid students in group and ^ 
dyad activities, etc.). 

Level of Operations (Direct Services ) i 

A. Rosewood Elementary Schools The,re were a total of 62 students 
(unduplicated count) served by this component during the year. 
There were approximately 20 persons who received services in 



\ 



/ both the fall and spring semesters. At least 3 of the students 



A- 



were beneficiaries or more than one type of component activity 
(e.g., individual counseling and grpup counseling for different 
problems.). 

Students wefp, referred from both 4th and 5th grades and came 

» - V 

from n tot»l of seven different hoinerooins. 

Activities included individual counseling and behavior modi- 
fication activities for students referred for fighting; or for 
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poor self imRResi socialization skills workshops for studenlJ* 
groups and special field trips. 

B. Sims TSlementary School i A total of k!j (unduplicated count) 
students received services from this component. Four of 
these students received services in both fall and spring; 
semesters. Twelve of the ^^5 students were "model students" 
who were selected to participate in writing a sOhool news- . 
p«per. These students were being "rev.'arde4* for their 
Kood behavior patterns exhibited. Tvio other model students 
were used in dyads involving students referred for problem 
behavior. 

Activities included art therapy, individual couneelirip, so- 
cialization skills counseling with groups and dyade, develop- 
ment of a school newspaper, training, in cultural heritage, and 
behavior modification activities. ^ 

Referrals •came from eleven classrooms. Interns worked 

J* 

primi^rily with students designated as non-Title I students 
since the counselor was limited by funding guidelines to 
serving only Title I designatedf students. 
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Allan Junior Hi^a:h School t Twenty elegit (unduplicated count) 

students received direct services as a result of this com- 
T>onent. Of these 28, six received continuous service through 

.the ffllli'and sprin<5 semesters. Eleven of the students were' 
dropped because the intern working with them was reassigned 
to Martin Junior High School (See comments in Potenti«?l 
Problem Section), Seven others were also dropped from re- 
ceivinfT direct services when the nature of the Intem^js 

^assignment was changed to one of providing more indirect 

services, * . 

I 

Activities included behavior modification activities and 
technique application, values .clarification ('role play) 
activities, individual iand group counseling sessipns, and 
field trips. ' 

, , * • ^ 

Referrflt^s ^ere made primarily through the counselors and 
administrative staff. Some students were selected by the 
interns from, observations jnade by the intern in classrooms 
and in other school situations and activities* 

» * 
Itertin Junior High School t There were thirty-one students 
who received c ^ect services from "this component. Six of 
them received more than one type of iervice. Ten students 
recflived services throughout both the fall and sprina; 
semesters < 
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-Activities Included home visits, field trips, behavior 
modification activities'v group counseling in health and 
hygiene, and individual counseling activities. 

Counselees were referred parents, teachers, and adminis- 
trative personnel. Referrals were directed through th6 
o/fflce of the counselor. 

I 

Level of Operations .(Indirect Ser-vices) ! Records of indirect 
services were not reviewed in -detail by the ^valuator. . The 
number. of students receiving these services was not determined 
since many activities involved families of students other than 
the referred studeiit^ Consequently, these children were often 
the beneficiaries of these inc.lrect services i althou^rh sorto o" 
.:.*3n stton'Ri other schools (e.-,, ;:■ r .10. i '»).iiu://?Hculty sun/cy 
Of. nttitU'GS toward school)* 

Activities iiiclude conducting attitudinal surveys e workin^^ with 
local support teams, planning and \^forking closely with school 
counselors In planning direct services, contacting parents 
regarding truant students, and working with community service . 

i ' 
i 

nfisencies. 
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Indie* tor% of Component Effectiveness 

A, Ob.lective meAsureai No systematic procedures have been 
established to objectively determine either individual 
success or ajroup progress within this component* Hecords 
«re kept as to specific activities of indi^viduals but pro- 

, ^ress measures appea^^to be primarily subjective in nature 
(mostly Individual "judgements). There is no explicit standard 
for deterniinini? whether an individual should be assigned to 
individual or ^r^up counseling activities (or to both types). ■■ 
\ Likewise, one ^ an individual joins an activity, it is likely 
thut the individual conti^iues in the activ^ity until the end 
of the school ydkr unless the individual terminates enroll- 
m<jnt ^'rom the school prior to the e;id of thi school year or 
services can nb longer be provided to the individual -.ecause 
of changes in the schedule or activities or assignment of 
the intern fs). ) , 

B. Subjective meafev^i^esi ' Several measures, some of which could 
easily ^e converted to objective use, a^ presently^ beine:, 
used to ^uge success of an activity and/or individual pro- 
gress. Among the measures being used arer \ 

- changes in frequency of involvement in negative behaviors 
(of which the counselor or intern are aware) 

apparent attitude of student although-h<^ 
baseline data is established about Initial attitudes. 
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rtejor Problem Areas 

Cemi>onent Knowledge of Budg6tlng Process t The most comiaon 
i^roblenr mentioned by Interns was. tne r^iiure uf the corriBo/; "it 
tCF DroviHe fund^ for foo^i and for specinj ia?>j;eri5^1f; -no^ ' • 
snjji^? t»ri"; n11lQ\;<^, Xiitorns ^-il not uhnrvr?t?ina thpt ^oo* 

ro^ts are ineligible cost items under the ^SAA furv^inp^ 
«ruHelines* v/henever such items were requested, the requests 
were routinely denied. As result, the rejection of such 
requests was perceived nec^atively by the interns. Likewise, 
requests for rugs, pillows, and other more permanent items 
v/^re denied because such, items must constitute line items, 
specifically, in the ESAA proposed budget* Since the person » 
who was |>rimarily responsible for negotiating the budfet 
items with component staff was no loni?er with \Project Assist, 
artd since this position was not immediately filled, the 
lack of budget clarification became a source at misunderstanding* 

I 

It is su^cested that copies of the ESAA funding sidelines ' 
he provided to all agencies participating in the ESAA-funded 
components. It is expected that there will be closer con- 
tact between Project "Assist administrative staff and tiie 
supisrvisors and/or coordinators of the components. As a 
resultt most of the misunderstandinfirs resulting from. the 

isolated cor^ition in which the compronent was operated this year. 

\ 

' \ 
. \ 
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^ek of Space t Interns in two of the schools, Allan and 
SlmSi did not have space designated for their- use on a 
re«ul«r basis. These schools have large enrollments and 
«»re otherwise rather crowded and cramfied for extra spacei 
it is understandable that appropriate adjustments must be 
made accordingly. Lack of regularly available space for 
counseling and other special activities of this. component, 
however, is likely to result in loss of time in finding 
unused space, notifying participants of changes in meeting 
places, in having participants-f ind the places promptly, 
and in moving materials back and forth. When space is 
available only at certain times of the day, this is likely 
to foster complaint's from teachers about students having to 
be .excused from class regularly in order to participate in 

r * 

non-academic activities. 

Participating schools should agree to provide at least 

minimum required space for the component activities on 

the days in which the interns will be working at the school. 
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3. Rensftlgrtment of Ittteme t ThP reagsifi^nment of social work 
interns onuses special problems for some students, who have 
been counseled regularly by the interns and who suddenly 
find that the s^price must be terminated* The aborted 
service is thought to give rise to additional behavior 
and adjustment problems on the part of such students. 

*• Provi8^ons might be made to have the caseloads of interns 
reassigned to other interns working, at the school or to 
h*ve the counselors work closely with thfe students during 
the transition period. Students thought to have special . 
emotion**! ^©roblems or behavioral adjustment problems ni^iru 
i>e congi lercri for special attention by the regular school 
counselor. ; * 

% 

\ . > 

4» Methods and Plftns for T^ollow^uo t There are no systematic 

T>l^»ns for ^ollowfub activities for students servequj^j^n the 

lQ7<-7^ :^r.rool ^'^^r. Lpnv o" t;/: .^xu .ients ^^re fifth graaers 

v;ho v^'lll be J^ttendintr six 3:rf*de in Schools not 'served by; 

Project Outreach. Uej^ interns assigned to present schools 

' will be serving students as they are referred during"\he 

197^*77 school year, pio carry-over .referrals are planned. 
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.Th« BS|IA- funded components, Trilogy and Pro jec4fe.<|)utreach, were not 
able to meet their objectives as initially proposed. Progima 
adjustments vfere made in both components* ItiB adjustments s^b to 
yb9 raftllstle and necessary In view of the start-up iind opera tlmial 
problems encountered^ by the components. The adjustments appear to 
heve been mede with every intention toward furthering the goaXe of 
the overall ^SAA proisrmme ^ 

Definite weaknesses v/ere found in the Tri!Logy ccmponent* The pri- 
ma^ weaknesses appear i;o\e in^anning ^nd , y elf -*di recti on rather* 
than in the performance! productionf or design^ mspects of the com-^ 
ponente Corrections in the planning process may necessitate Itilnor 
0han^es in and/or additions to the basic design of the component* 
Such changes 9 however » should increase the likelihood of success 
in meeting the overall objectives* 

Project Outreach has provided mtost of the services proposed in^the 
funding proposal. Areas in which additional attention might be 

jT ■■ . ' r ' 

^^^Jjavcted arei 1) the designation of one person to serve as a 
coordinator of activitie^" of the Interns within the individual 
•choolsf and\2) clarification of the role of Interns providing in- 
diirect serviceet. Services to be provided by these interns should 
be specified and the number of persons to be served shoufd be estimated 
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/ Speclflcatyp of tf»€? meHjhoda «f contact and referrals for indirect 
■ervices should be included in the proposal also. 

The fun^ini? proposals of the individual coraponentP as submitted to 
the ^SAA office appear to be 6nly skeletal in nature. In addition 
to. the proposals submitted to ^SAA, there should be kept on file 
complete sets of component plans which include dpeiJific information 
a« to the number and types of beneficiaries, specific procedures to 
be used, and measurement techniques proposed for determining cm- 
ponent efficiency and ef fectivertess. Such information is essential 
to an wi-i?oi:ng planning effort, to systematic identification of 
potential pjroblem ^eas and needed changes in operational vLevels 
and procedures', "and in' providing a basis fojr evaluation. 



Mfia IMP BHpm i SCHOOL ^ULSTRXCI 

r* 

lEiCnONS TO TKWOSXi . 

>nA IS n, AHD ROW DID YOQ tnz-itt 



BiM94 oa Cod«y't p«r£onwae«, vhat do 'yott!b«liav« tfa« ataibtr* of 
tvlionr «N trying to aeeoaplith? ^OHhtA v eb« Mjor gMls of ' 



Hov offoctivoly at* th«y aeotlng thes«'go«l«, in your opinion? (Cirelo) 

I \ 2 ^ 4 5 

Irnvf SamnAuA Neutral SaawwiMt Vary 

Sfftetivoly . Effoctivtly Inoffoctivply Inoffactivoly 

Vh«t did you anpifcially lika about today's parfrapanea? 



•Vlut did yo9 ••p«cl4lly dialika? 



# 

l^mt sttitaieloiui do you lunr« for loptovcMot? 




MiK ar* lOM lof^i tMchar, 8jtud«nt» family and school pressur«s-on 
tiM •iMMi iitar y Icvil that could be inva«clgaied with nethods Ilka those 
«tsa4 in Trilogy? ■ - ' 



7* Can tha usa of drana techniques like those used in Trilogy be adapted 'to 
tba alesMntaxy^^^eveU x 

a« For students to watch? ' 



Y«a,vary wall 



no opinion 



5 

not not 
%t al l 



,ba For ttudontt to participate in ai ca«t anbari? 



Tasyvaty wall 



no opinion 



nOf^ not \ 
at all* \ 
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Attachment B 

• List- of Contacts Made Durin«c Evaluation 

Mr. Roosevelt Thomajs, Principal, Sims Ej^ementary School 
Mr, Jerry Richard, Principal, Allan Jr. Hi<;h School 
Js. Jetta Todaro, Director, Project Assist 

M*. Bobbye Kincheon, Staff Development Director, Project Assist 

Ms, Eunice Garcia, Coordinator, Project Outreach 

Mr. Dan Robertson, Coordinator, Trilory 

Ms, thelma Madison, .Teacher, Sims Element-. School 

Ms. Eucnie Houston, Counselor for Title I "ims Elementary School 

Ms. K err. Teacher, Sitns Elementary School 

Ms. Dorothy Marshall, Teach€r, Allan' Jr. Hi^h School 

Ms. Rita Henson, Teacher/Consultant, Allan Jr. Hi*?h School 

Mr. Larry Flsner, Proje*ct Outreach Intern 

Ms. Laur« Urdaneta , Counselor, Martin Jr. High 

Ms. Linda Vozelle, Director/Sponsor, Eastside Express 

Ms.-Trudie Preciphs, Project Outreach Intern i 

Ms. Mary Acostfl , Project Outreach Intern 

Mr. Ron Ortman-Glick, Project Outreach Intern 
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AUSTIN Il^nEPKNDBfff SOIOOL DISTRICT 
Division of Edueotloiuil Dcvelcpncnt 
Department of Developmental ProcTans 

. PROJECT ASSIST III 



Sot PttrioiM Addrcitcd ^^^1 197^ 

Froa: J«cc« A, Todaro, Pioject Aaiiic Coordinate r^jjt^|^^ju^ 

U: Contracted Procais Evaluation Report for Priirt 
Aaaiat III (Lym and Krueck). 

jy Coordinator of Project Assist has reviewed the doctnent presented 
Mr Lya and Krueck regarding the Instructional Aide Component. Protect 
"tJuA, and Project Math. The evaluation did not include and/or emphasize 
Mveral inportant points concerning the context vichln which Project 
Aaaist took place. The following items niusc be considered when the 
report is studied: 

!• Due to late funding because of Justin Independent School District's 
«j-co«pliancu with tho Office \t Civil Right,, regulations, the 
Pilot did not begin until September 2^ 1975. 

2. September «. 1973, the Pro'-ct Coordinator resigned. The St»ff 
P^iSf*"' f***"**^""'"' inse^ice on September 

i ** \rV ^".'^""S coordinator. fiUittg both positloS. until 
^ « oew Staff Oevclopaent Coordinator was hired. 

3. the. Staff Development Coordinator was not hired until January 19 1975 
Three attempts were made with the Personnel Office to choosrapplicant; 

5a« con^J^J-'^b^^L"'"""""' ^''^ Willing^., to llave" 
tflm contract job, and accept a "grant contract" Job. A furtht 
delay was caused by the necessity of findAg a replacement for the ' 
person ciioi»ena # * 

4. ][»«« above factors precluded complete and Inrftviduallzed staff devel- 
epMnt of aides on a preservice/lnsexvlcS basis, and it prevented the 
3*S:"e«! ' '"'"^ together, at thJ beJJS^Inr 

'* ^l««»«ntetion st«g«< of the program, 

other changes took place: . - f-ataBi, 

«. The Martin teachers who had designed the math program were no 
looter at Hartin Jr. High. They were replaced by%hrer"aSers 
•Ither new to the district, or new to Coaching. "'^^n*" 

b. Martin had two major changes in the 'position of principal from 
AHtttst to Novemb4<r, 1975. ««*pa* srom 



fftTM^si Evalu«tioii md KanasMiit Audit • ctd. 
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€• Tte facilitlM given to the t^eehere mt Martin to i^rlcoient 
the ^leb Approach** wre not conducive to a lab or claaaroott 
altuation* 

4« The achool itaffa requeated that the aidea be placed on 
I HI mi aa aoon aa poaaible after hiring in order to begin 
actual claaarodn orientation and inaervice yifk the 
dlaaarooii teachera. 

e. The Mteriala vera to have been choaen in July and Auguat, 
19759 however becauta of late funding, one ataff aesber, and 
a Aonth of jiide preaervice, the .rcctuiaitloniQg of auiteriala 
4id not begin Until October » 1975. ^* 

l« In Septesber, 197St the diatrict ataff frdi the Oiviaion of 
Inatruction becane more involved in Project Aeaiatt providing 
Input into the choice of curricula and ttateriala to aupplettant 
the diatrict programa. Thia proved to be a definite aaaet to 
the project » although it involved aote coordination between 
ataff and teaehera. 

6« The preaent Coordinator offered the reading and math curricula aa 
atated in the propoaal as poaaibilitiea to the project achoola. They 
have had their chofice throughout tlie year to chooae inatntetional 
matetiala and inaervicea in those areea. Given the atated context 
of the project, it was not thought to be poaaible nor beneficial to 
**dictate** the program aa deaigned« but only to offer choicea^fdllo%i* 
Ing the plana aa cloaely as poaaible. 

7« It ahould be emphaaiaed that until January 19 » 1976; there vm in* 
auff icient staff to aystematically monitor the project aa planned. 
Peri^ic viaits and formal or informal costtunicatlon between the 
.aaboola and existing Project Aaslat Stal^did occur in order to 
aupport and continue to implement all ,aapecta of the pilot. 

8. The guidelines of the pilot were reviewed in deta^.! with each project 
principal during the first week of Septeiiber. Any discrepanciea regard* 
ing auch itdma as the aelection or placement of aidea occurred with the 
full knowledge of the guidelinea a^ were Juatified on the baaia of 
achool needa. 



gsisad on the context deacribed and the evaluation report « I would like to 
mAM a number of recoatendationa: 
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!• Ibm Coordinator and the Staff Development Coordinator should continue 
to asfoil fachcr and aide needs regarding the program components and * 
Mterials throu^ formal and lnform;il corannuilcatlon vlth the principal t 
faculty and staff* This vlll provide for the ongoing Improvement of 
the program* utllixatltm of ouiterlals and services offered* 

2« The Staff Development Coordlna^tor should continue, to systematically 
monitor £Ke instructional aides In order to ascertain their effective* 
ness within the program, and provide detailed observation forms assess* 
lag their professional activities as a basis for providing ongoing 
staff development* 

3« The Staff Development Coordinator should continue to systematically 
■ooltor tlie Instructional aides In order to provide adequate inform* 
ation for complei:lng the evaluation and recommmndation forms* 



4« The project staff should continue to offer assistance in the areas of 
inatruction delineated in the program narrative* under Project - Read and 
Froject Math* 

• . • 

S* The project staff should continue to assist the appropriate teachers 
idth the managemcui: 4nd Resign of their classrooms vtiereVer possible* 
given the arrival of materials and the school coaaitment necessary to 
operate the program* . r 

6* The Project Coordinator should schedule closeout rnMrvice sessions 
vlth each school staff at an appropriate time to revieir evaluation 
information, to discuss the closing of Project Asslst^and to review 
the project's effect on the school program* 

7« The Project Coordinator should schedule meetings with the -targeted 
1976*1977 schools in order to make plans for the implementation of 
the new ESM pilot if funded for another year* 

8* pe Project Coordinator should establish procedures vlth the Austin 

Independent Sch^jl District's Personnel Office regarding the reconnend* 
/ationr and placement of Project Assist aides in available district pro* 
/ grams at the termination of the present ESAA pijLot* 

9* The Project Coordinator should continue to review the proposal with 
the principals regarding the implementation of components for the 
remainder of the year and provide ongoing documentation of the 
changes in the programs » and the reaaoAS-for the changeSi with the 
appropriate agencies* 

10* f The project staff should complete the process of the transfer of 
materials from the previous to the present elesMntary project 
schools* 

11* A preliminary evaluation and audit would be more beneficial to the 
project staff if it occurred at an early time iti the year (i*e« 
Mo v ert e r) in order to determine changes in the program* 
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^roMM Bvaluation mui MftMgmmt Audit • ctd« 4 

3 

It. lated on the liaitatlon of the evaluation and audit expretaed by tym 
and Krueck» the project and evaluation ataff ahould, if poaatble» 
attea^t to dcternine policies and methoda regarding the collection 
of the data for aaeeasment purposca. 

Ihe reaMlndcr ol the projece will b« spent in the ongolns iaplcMn- 
tatton of the components, in following the recoaaendations . and in 
. preparing the closeout reports. 



I 



160 



AOM. •04 



AUSTIN INDEPENDENT SCJHOOL PISTRICT 

OFFICB MEMO 

r#t Dr. iidk t. OsrldMtt . Dmt A/27/76 

ixilMf: Ftojtoi Assist Bfftlttiiloo 

ths eeassnts oT JstU Todsro hlfrhlie^ very wtll two, 
poidts thtt I bave trlsd to uks a^Mlf • 

X. Ikplmsnlttlca problsat «t ntnj >vils Xsadi to 
fsdsMl jMrogna fliilnxtf • 

24 An adsqasts svsloiitloo ahotld eXtsrHar tf oc if t A 
s«eh pniblsns la » spsidy fMhioB. 1tafertiiMts]7t 
tte TCsonress sUee«t«d to I¥o>et Assist mrm 
iasvffialmiit to frpfU* this of frsesss 
svBlastioo sad ths sactszsil sitt Tislt sirsnseh 
MS siMitvtsd. ixfesnal svtlnators wtfAr 
hnrn tins or ssesss to proesss stslsitien lafonstion. 
?fe«ssss iaftewtloB is Mst iBperfcaiit to profTM 
ili r o is m n t , bat it is -^ sc s t ssqptssivs to 
gstlisr m4 ptovldis* 

fbsss OQMSilts Mm bo iBBlnM sl«?M» ths sxtorssl 
ovoiostloas la tbs fiml rtport. Venrnw, 4ss|>lto tbs 
tsssows thst lod to iMplsnititioit Mlvrs it tbs 
poii* of ttart sits visit, ths vltiflsts rosoU for tto 
ysor «m pFtimVSj bo thatt stiMts 6iA vat Issnn aors 
«• ft rosolt of tbs f«o>«t sacnsndliwss* Tht 
ioso«<sbUity for thst fbiX a ro b s foad tbs Uto 
tmdiM^ sad fiiitelim rostrietions fraa 0903— Uss with 
•U fif as, tbs tetsl sehsol systasi. Bsosora for 2!slliirs 
am bs Irrolovant to tho Mtare of thost ptadssts m 
idght bsvo hsipsd. 

ee: Mauro Royna . 
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GLOSSARY 



1. affective a term used to describe feeling or enotlon Instead .of 

thougttt. 

2. California Achleveaent Test - an Inatrtment which seaaurea a3>illty 

to undejratand the cortent Mterlal 
presented 9 particularly Bngliah iracab- 
ulary and coBprdienalon» in ptogreaaively 
dlfiElcult aituationa* 

3. cluater groups - groups f orned around one target chilly vith group 

Aaabers selected by the child, 

4. cognitive - a term used to describe mental proceasea or tbou^t. 

5. comparison schools - schools generally compatable to a project 'a 

target schools but which d^d not have the given 
project operating in them^ The pr<igraaa of 
student a in compariaon aehoola la tompared to 
the progreaa of atudentb In target achoola/to 
aee if the program h^pad the target achool 
students. 

6« context - the situation in which the project functiona; factora, both 
poaltlve and negative, tbajt: prevail in the ezperimanUl 
and control altuatlon» ov^r which the projact haa no cdntrol. 

7. criterion measure - the test» quest iottnaire» or other instrument uaed 

to determine vhather an ol J active or other a tat ad 
level of performance haa*been attalnfml. 

8. decision questions * questions concerning the effectiveness of the 

progx'am^ posited by ayatem, program, and achool 
staffs, and for which data la aupplled by the 
evaluation staff* 

9. ESAA - Mergency School Assistance Act, passed by Congress in 1973, 

to aid schools .undergoing the desegregation process. 

10. evaluation daalgn - an outline of /a system by which the evaluation 

of a- progrsm will proceed. 

11. gain a atatlatlcal Increaae; usually d^Iined aa the difference 

between a preacore and a poatscore. 
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12. genfiral aide * person whose purpose ^nd training Is directed 

^ toward overall assistance to students and teachers » 

/ and whose duties are not specifically predefined. 



13* inputs -/resources such as extra staff, training » and project 
(activities Which occur outside the classrooB. 

14* inservlce training - any training which occurs 

the Instructional phase of a prcgrt 



ilng, and project ^ 

:lassrooB. ^ 

rs after the start off 

of a mogvam. / 



15. Instrument - a test; a measure; an evaluation tool. 

16. Llkert-type scale - a question format which contains a statement 

followed by a c^ntlnuum^of responses from vhlch a ' 
person Is asked to choose and designate the response 
most llk^ his /hers on the statement* 



Example: Hew much do you use your Project Assist aide for reading 
Instructional activities?" 

1 2 3 4 5 

never rarely sometimes often always 

17. Math Attitude Test - an Instrument constructed by the Office of 

Research md Evaluation to measure stad^ats* 
attitudes toward math and math dassM. 

18. mean the average of a set of nuabArs.- 

19. observation - a period of time during which a process evaluator/ 

classroom observer witnesses and records* for the purpose 
of evaluation*, the various functions* resources* and 
activities of a classroom. 

20. outcomes - the results of the project* defined In terms of student 

behaviors and achievements. 

21. pilot project - a term used to characterise an experimental program^ 

the effectiveness of which Is being ascertained. 

/ ^ 

22. posttest - a second adiianlstratlon of a test after an Interval of time 

In order tol measure Individual gain or loss In areas 
covered by^the test. 

23. preservlce training - Job-related training given before the start 

of the Job. In ProJer:t Assist* It refers to 
training to be glvto to aides and teachers 
before the start (ff school. 




163 



172 



24. pretest - an Initial administration of a test that Is to be administered 
again at a later date In order to measure Individual, gain 
or loss In areas covered by. the test. v 



25. probability «• an arithmetical expression describing the likelihood of 
i an occurrence of an event. For example, a probability 

of .05 means that the difference In scores between ' 
two groups could be expected to occur due to *chance 
alone only five times out of a hundred. 

26. processes - In reference to Project Assist » the classroom activities 

which utlllase the project Inputs and strive to yield the 
project outcomes. 

27. process evaluation - data gathered througji various Instruments and the 

observation of behavior In a classroom situation* 

28. ' program Implementation - the process of putting a program into 

operation. 

29. programmed Instruction * a method «of Instruction In which the material 

tb be learned Is broken down Into small » 
progressively more difficult steps t which are 
^ to be learned In sequence. 

30. Project Assist aide * person whose purpose and training Is directed 

toward giving reading Instructional assistance 
to teachers and students. 

31 Project Math - The' math component of 1975-76 Project Assist, Including 

Instructional aides and materials and a special 
curriculum, to be Implemrated at Martin Jr. High 
School . 

32. project Outreach - The social work component of 1975-76 Project 

Assist. Through this component, graduate 
social ^work Interns worked with referred Project 
Assist students. 

If V 

33. Project Read - The reading component of 1975-76 Project Assist, for • 

which the majority of the year's funds were appropri- 
ated. The component was proposed to include instruc- 
tional aides, suppelmentary materials, and a special 
curriculum. 7 

34. random selection - a sample of the members of some total population, 

selected in such a way that rvery member of the 
population has en equal chance of being included* 
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